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EXECUTIVE  SUMMARY 


One  of  the  products  of  the  Flight  Service  Station  Engineering  Laboratory  located  at 
the  Federal  Aviation  Administration  (FAA)  Technical  Center  is  an  engineering  model 
designed  to  explore,  through  development,  test,  and  evaluation,  the  application  of 
digital  technology  to  the  mass  dissemination  of  meteorological  and  aeronautical 
information.  A  major  component  of  this  system  is  an  Utterance  Recognition  Device 
(URD)  used  for  recognition  of  human  speech  over  telephone  lines.  In  the  latter 
part  of  1979,  the  Technical  Center  undertook  an  extensive  effort  to  upgrade  the 
URD  in  preparation  for  testing  the  capabilities  of  voice  input  for  flight  plan 
filing. 

The  URD  was  modified  to  include  more  reliable  components,  where  advisable,  and  a 
larger  memory  to  handle  an  expanded  vocabulary.  To  improve  recognition  accuracy 
and  provide  greater  convenience  (i.e.,  error-free  recognition  without  cumbersome 
repetition  and  annoying  question  and  answer  dialogue),  it  was  essential  to  develop 
sufficient  capability  to  handle  differences  in  pronunciation  due  to  the  regional 
variation  in  speech  between  individuals.  With  the  assistance  of  outstanding 
linguists  in  American  dialects,  a  dialect  study  was  conducted  to  determine  the 
locations  for  collecting  a  nationally  representative  voice  sample  for  use  in 
creating  reference  patterns  capable  of  performing  well  on  all  American  dialects. 

The  consensus  of  the  experts  suggested  a  speech  sample  from  the  locations  and 
dialect  areas  shown  in  figure  E-l .  The  target  sample  was  (100  male  and  100  female) 
from  each  location  indicated  in  figure  E-l.  Each  subject  read  the  words  in  the 
special  purpose  vocabulary  over  the  telephone  into  a  recording  device.  The  voices 
of  the  individuals  reading  the  list  of  words  were  later  processed  into  a  vocabulary 
data  base. 

The  voice  collection  effort  began  in  February  1980  and  ended  in  January  1981. 
During  this  period,  5,617  voices  were  collected  and  processed  into  a  vocabulary 
data  base;  2,251  voices  were  recorded  from  FAA  personnel.  It  was  extremely 
difficult  for  the  Technical  Center  to  unilaterally  find  diversity  and  number  of 
speakers  required  within  the  staff  of  FAA  alone.  For  this  reason,  two  other 
government  agencies  were  asked  to  assist  the  Technical  Center  in  the  collection  of 
data.  Subsequently,  an  additional  3,366  voices  were  recorded  from  employees  of  the 
Internal  Revenue  Service  and  Social  Security  Administration. 

The  hardware  modifications  were  made  in  April  of  1980.  The  new  vocabulary  data 
base  and  recognition  software  were  installed  in  November  1980.  In  January  of  8981, 
initial  tests  were  conducted  in  which  subjects  filed  simulated  flight  plans 
directly  into  the  URD  over  the  telephone.  Fifteen  subjects  (12  male  and  3  female) 
from  the  Technical  Center  participated  in  the  initial  test.  Fourteen  subjects 
tested  were  inexperienced  users.  That  is  to  say,  they  were  untrained  and  inexpert 
in  talking  to  an  utterance  recognition  device.  One  subject,  experienced  in  talking 
to  word  recognition  machines,  was  used  in  the  test  for  the  purpose  of  comparison. 
Three  of  the  subjects  were  general  aviation  pilots.  The  subjects  differed  in 
cultural  and  geographic  origin. 
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FIGURE  E-l.  LOCATIONS  FOR  VOICE  O  LLECTir 


Using  the  phonetic  alphabet,  a  set  of  numbers,  and  several  control  words,  each 
subject  entered  four  simulated  flight  plans  —  two  with  visual  flight  rules 
(VFR)  and  two  with  instrument  flight  rules  (IFR).  However,  not  all  of  the  flight 
plan  data  were  entered  by  voice  recognition.  As  would  reasonably  be  expected, 
the  requirement  to  spell  out  every  flight  plan  entry  phonetically  reduces  the 
attractiveness  of  computerized  word  recognition  or  any  other  direct  character-by¬ 
character  entry  system  (i.e.,  Touch  Tone™  or  pilot  self-briefing  terminal  (PSBT)) 
for  flight  plan  filing.  The  fact  is  that,  even  at  100  percent  accuracy,  the 
protracted  length  of  the  transaction  seriously  diminishes  the  attractiveness  of 
filing  in  this  manner. 

As  a  rule,  the  speech  channel  loses  its  appeal  as  the  language  departs  more 
and  more  from  natural  speech.  On  the  other  hand,  by  handling  only  those  entries 
that  are  sent  to  the  National  Airspace  System  (NAS)  or  destination  Flight  Service 
Station  by  utterance  recognition  and  the  remaining  entries  by  prompted  . ecording, 
the  protocol  is  more  natural  and  compatible  with  the  task  situation.  This  approach 
is  based  on  our  assumption  that  the  requirement  to  spell  out  every  flight  plan 
entry  character  by  character  would  try  the  patience  of  the  users. 

The  results  of  the  initial  test  are  summarized  in  table  2,  in  the  Results  section 
of  this  report.  The  numbers  in  column  2,  "Total  Words  Spoken,"  are  the  total 
number  of  words  spoken  by  the  subject  in  entering  all  four  flight  plans.  Column  3, 
"Please  Repeat,"  shows  the  number  and  percentage  of  utterances  that  were 
unrecognized  by  the  computer.  This  occurred  when  the  computer  could  not  make  an 
identification  and,  therefore,  asked  for  a  repeat  speech  sample.  Column  4  reflects 
the  number  and  percentage  of  misrecognized  words.  Not  all  unrecognized  and 
misrecognized  words  were  due  to  system  error.  A  significant  amount  were  a  result 
of  user  errors,  such  as  speaking  words  that  were  not  in  the  vocabulary  data  base, 
speaking  two  or  more  words  at  a  time,  not  confirming  an  entry  with  a  "yes"  or 
a  "no,"  speaking  before  the  cue-tone,  etc.  Nevertheless,  the  majority  of 
misrecognit ions  were  the  result  of  system  error.  Column  5  shows  the  accuracy  of 
the  flight  plans  as  finally  completed  after  corrections.  The  percent  of  accuracy 
was  determined  by  dividing  the  number  of  words  recognized  correctly  by  the  number 
of  words  in  the  flight  plans.  As  reflected  in  column  5,  10  out  of  the  15  subjects 
were  able  to  file  flight  plans  (two  VFR  and  two  IFR)  that  were  100  percent 
accurate.  The  flight  plan  accuracy  attained  by  the  other  five  subjects  ranged  from 
93.2  to  99.4  percent.  The  total  number  of  words  spoken  by  the  subjects  shown  in 
column  2  exceeds  the  number  of  words  in  the  flight  plans  as  shown  in  column  5.  The 
reason  for  this  is  that  each  entry  must  be  confirmed  with  a  "yes"  or  a  "no" 
(affirmative  or  negative).  It  is  important  to  note  that  the  overall  accuracy  after 
corrections  for  all  of  the  flight  plans  combined  was  99  percent.  In  short,  the 
results  of  the  initial  test  are  exceptionally  encouraging.  It  appears  that  the 
dialect  study  and  the  voice  collection  effort  led  to  an  outstanding  improvement  in 
recognition  accuracy. 

In  March  1981,  a  comparison  was  made  between  the  old  and  new  recognition 
algorithms.  A  test  set  of  200  voices  was  entered  against  the  old  and  new  reference 
patterns  in  order  to  gauge  the  improvement  in  recognition  accuracy.  The  test 
set  was  not  used  in  the  construction  of  the  reference  patterns  and  was  selected 
across  recorded  dialects.  Judging  from  the  results,  as  shown  below,  it  would  be 
reasonable  to  assume  that  the  improvement  in  accuracy  with  the  nev  -’-ta  base  would 
raise  the  performance  of  the  Mass  Weather  Dissemination  Engineering  Model  to  a 
level  quite  satisfactory  for  the  general  pilot  population.  The  model  only  uses  the 
following  three  vocabularies: 


Accuracy  With  New 
Data  Base 

97.2  percent 

97.9  percent 

96.5  percent 


Since  the  test  set  included  a  broad  range  of  American  dialectal  variation,  it  was 
considered  to  be  a  reliable  gauge  for  estimating  how  well  the  system  might  perform 
on  a  nationwide  basis. 

After  studying  the  test  results,  it  was  concluded  that: 

1.  The  prototype  system,  as  demonstrated  using  the  adaptation  strategy  f  flight 
plan  filing,  has  definite  potential  for  application  to  an  enhanced  Model  of  the 
Flight  Service  Automation  Program. 

2.  The  requirement  to  spell  out  every  flight  plan  entry  character  by  scter 
would  try  the  patience  of  the  users.  Even  at  100  percent  accuracy,  the  ]  ted 
length  of  the  transaction  diminishes  the  attractiveness  of  filing  in  thi  ,*ier. 

3.  The  improvement  in  recognition  accuracy  with  the  new  data  base  would  raise  the 
performance  of  the  Mass  Weather  Dissemination  Program  to  a  level  quite  satisfactory 
for  the  general  pilot  population. 

A.  The  dialect  study  and  voice  collection  effort  led  to  an  outstanding  improvement 
in  recognition  accuracy. 

The  following  recommendations  are  made: 

1.  Simplify  the  procedure  for  filing  a  flight  plan  by  voice  recognition.  Obviate 
the  necessity  for  the  pilot  to  spell  out  every  flight  plan  entry  character  by 
character. 

2.  Develop  additional  software  to  allow  for  further  correction  and  edit  caps  bilit>. 

3.  Develop  written  instructions  for  training  general  aviation  pilots  on  how  to  use 
the  system  effectively. 

4.  Install  a  telephone  line  in  the  Millville,  New  Jersey,  Flight  Service  Station 
to  allow  volunteer  general  aviation  pilots  to  access  the  system  at  the  Technical 
Center  and  file  sismlated  flight  plans  by  machine  recognition.  Project  personnel 
should  collect  objective  and  questionnaire  data  on  system  performance.  (Note: 
Approval  from  OMB  must  be  obtained  prior  to  testing.) 

5.  Encourage  user  growth  by  permitting  the  system  to  become  progressively  more 
flexible  with  greater  efficiency  of  input  as  the  user's  skill  and  confidence 
increase . 
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INTRODUCTION 


PURPOSE. 

The  purpose  of  this  effort  was  to  develop  and  demonstrate  the  xapabi 1 1 ty 
automatic  filing  of  pilots'  flight  plans  by  computerized  word  recognition.  T:.t 
report  presents  the  results  of  that  effort. 

BACKGROUND . 

.  major  component  of  the  Mass  Weather  Dissemination  Exploratory  Engineering  Model 
located  at  the  Federal  Aviation  Administration  (FAA)  Technical  Center  is  an 
"iterance  Recognition  Device  (URD)  used  for  recognition  of  human  speech  over 
■lephone  lines.  It  is  the  only  known  commercially  available  recognition  machine 
' n  the  United  States  designed  for  use  on  a  switched  telecommunications  system, 
"n  1979,  the  Technical  Center  was  given  the  task  by  the  Systems  Research  and 
Development  Service  (SRDS)  to  develop  and  demonstrate  the  capability  of  automatic 
flight  plin  filing  by  machine  recognition.  In  response  to  the  request  from 
SRDS,  the  Technical  Center  undertook  an  extensive  effort  to  upgrade  the  URD  in 
preparation  for  testing  the  capabilities  of  voice  input  for  automatic  flight 
plan  filing.  The  URD  was  modified  to  include  more  reliable  components,  where 
advisable,  and  a  larger  memory  to  handle  the  expanded  vocabulary.  Moreover,  a 
dialect  study  was  conducted  to  determine  the  locations  for  collecting  a  nationally 
representative  voice  sample  in  order  to  create  reference  patterns  capable  of 
performing  well  on  all  American  dialects.  Subsequently,  over  5,000  voices  from  2 « 
cities  throughout  the  United  States  were  collected  and  processed. 


SYSTEM  MODIFICATIONS 


HARDWARE . 

The  URD  improvement  program  included  the  purchase  of  four  new  components  to  the  URD 
system.  These  components  were  (1)  a  new  floppy  disk  subsystem;  (2)  an  extension  of 
the  internal  D  memory  from  250  to  500  kilobytes;  (3)  a  solid-state  voice  response 
unit  with  a  capability  of  96  words;  and  (4)  a  new  analog  bay  incorporating  a  number 
of  improvements. 

FLOPPY  DISK  SUBSYSTEM.  The  old  floppy  disk  was  a  Dynastor  model  which  operated  at 
a  very  high  speed  and  utilized  a  floating  head  which  did  not  physically  contact  tie 
storage  medium.  The  disk  was  excellent  for  systems  which  remained  operating 
constantly  over  long  periods  of  time,  since  the  medium  did  not  wear  out.  Standard 
floppy  disks  had  a  wear  problem  in  the  days  when  the  URD  was  first  designed.  The 
UPD  had  many  interruptions  and  changes  in  media  due  to  the  nature  of  development 
work.  The  starting  and  stopping  of  this  high  speed  system  caused  a  large 
percentage  of  system  failures.  In  addition,  the  single  Dynastor  did  not  have  the 
norage  capacity  required  for  the  expected  new  programs  and  the  large  data  bas» 
necessary  to  change  the  flight  plan  filing  program.  Consequently,  the  Dynastor  was 
removed,  and  a  dual  DSD  440  floppy  disk  was  installed  in  its  place.  The  new  disk 
has  twice  the  capacity,  is  not  subject  to  difficulties  from  repeated  loadings  am. 
unloadings,  and  exhibits  only  little  more  wear  than  the  Dynastor. 
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FIVE  HUNDRED  KILOBYTE  D  MEMORY.  The  D  memory  is  the  main  fast  and  volatile 
storage  of  programs  and  data  base  for  the  URD.  The  increase  in  data  base  size  from 
25  to  75  words  in  the  data  base  (vocabulary  memory)  required  this  extension  to  the 
systems  capabilities. 

SOLID-STATE  VOICE  RESPONSE  UNIT.  The  URD  depends  on  its  own  voice  response  to 
verify  the  word  or  string  of  words  spoken  before  they  are  passed  to  the  Interdata 
7/32  computer.  It  has  special  routines  to  accomplish  this  and  requires  that  each 
word  in  the  vocabulary,  as  well  as  prompting  or  questioning  phrases,  be  included  in 
the  Voice  Response  Unit  (VRU).  The  previous  system,  a  Cognitronics  "speechmaker , " 
was  based  on  a  revolving  optical  drum  and  was  limited  to  31  words.  Verbex,  the 
manufacturer  of  the  URD,  had  a  new  solid-state  system  based  on  the  storage  of 
compressed  digitized  speech  on  16  kilobyte  E  proms,  one  for  each  word  of  about 
one-half  second.  The  new  system  had  a  capacity  of  96  words  and  was  considerably 
more  reliable  than  the  revolving  drum. 

NEW  ANALOG  BAY.  The  analog  bay  is  that  part  of  the  URD  that  handles  the  eight 
channels  of  telephone  signals.  It  contains  the  amplifiers,  channel  switches, 
analog  to  digital  converters  and  a  number  of  diagnostic  subsystems.  The  new 
analog  bay  was  selected  to  replace  the  old  one  because  it  possessed  the  following 
features:  (1)  better  grounding  reducing  occasional  cross  talk  on  the  telephone 
channels;  (2)  automatic  gain  setting  amplifiers  which  compensated  for  weak  or 
strong  telephone  lines;  and  (3)  system  diagnostic  provisions  which  were  developed 
after  the  previous  URD  was  built. 

SOFTWARE . 

The  major  reason  for  the  new  software  was  to  change  the  capability  from  the  weather 
dissemination  routine  to  the  flight  plan  filing  routine.  Since  the  latter  is  a 
more  extensive  program  with  regard  to  word  recognition,  two  major  changes  were  made 
with  respect  to  the  previous  program.  The  first  of  these  was  the  ability  to  enter 
words  in  strings  of  from  two  to  five  words  separated  by  prompting  "beeps."  The 
string  was  then  verified  by  being  repeated  with  the  voice  response  unit.  The 
second  major  change  was  that,  once  the  user  verified  a  string,  each  of  the  words 
spoken  were  adapted  to  the  stored  patterns  and  became  a  new  data  base  word  during 
the  current  telephone  call  and  only  on  that  caller's  channel.  This  transparent 
training  of  the  system  to  the  user's  voice  considerably  improves  the  accuracy  of 
recognition  upon  subsequent  use  of  those  words. 

In  addition  to  these  capabilities,  the  new  software  program  controlled  the  auto¬ 
matic  gain  setting  of  the  channel  amplifiers,  controlled  the  verification  and  voice 
response  routines,  and  provided  for  more  extensive  diagnostics.  The  system  was 
also  designed  so  that  the  7/32  computer  could  command  any  of  15  subvocabulary 
groups  as  appropriate  to  the  current  flight  plan  entry.  Since  these  groups  were 
considerably  smaller  in  number  of  words  than  the  whole  vocabulary,  this  resulted  in 
a  significant  increase  in  the  probability  of  correct  recognition. 


DIALECT  STUDY. 


To  help  assure  accuracy  and  convenience  (i.e.,  error-free  recognition  without 
cumbersome  repetition  and  annoying  question  and  answer  dialogue),  it  was  essential 
to  develop  the  capability  to  handle  differei,  pronunciations  of  a  given  word  due  to 
the  variation  in  speaker  dialects.  Thus,  a  dialect  study  was  conducted  with  the 
assistance  of  outstanding  linguists  in  American  dialects.  The  purpose  of  this 
study  was  to  determine  the  locations  for  collecting  a  nationally  representative 
voice  sample  for  use  in  creating  reference  patterns  capable  of  performing  well  on 
all  American  dialects.  One  of  the  major  difficulties  in  speech  recognition  is  the 
variation  in  speech  between  individuals.  It  is  important  to  note  that  the  problems 
of  dialect  differences,  in  relation  to  speech  recognition,  are  a  relatively  new 
area  of  investigation. 

The  design  and  results  of  the  dialect  study  can  be  found  in  report  number 
FAA-RD-80-1 15  entitled  "An  Investigation  into  the  Effects  of  Dialectal  Variation  on 
Flight  Plan  Filing  by  Machine  Recognition"  dated  January  1981. 

The  dialectal  variations  in  pronunciation  are  generally  written  in  International 
Phonetic  Association  (IPA)  symbolism.  However,  this  notational  system  is  so  highly 
specialized  that  readers  outside  this  area  of  specialization  could  not  be 
expected  to  understand  it.  Therefore,  to  give  the  reader  some  idea  of  the 
actual  distinctions  in  dialect  differences,  a  recording  is  contained  in  the  above 
mentioned  report  (FAA-RD-80-1 15)  which  includes  selected  regional  pronunciations  of 
the  words  in  the  expanded  vocabulary. 

VOICE  COLLECTION. 

The  dialect  study  identified  24  cities  for  voice  collection.  The  voice  collection 
effort  began  in  February  1980  and  ended  in  January  1981.  During  this  period, 
5,617  voices  were  collected  and  processed.  The  Technical  Center  arranged  for 
personnel  in  those  cities  to  call  a  recording  station  located  at  Verbex, 
Incorporated,  of  Bedford,  Massachusetts.  The  voices  of  the  individuals  reading  the 
list  of  words  were  recorded  for  later  processing  into  a  vocabulary  data  base. 
Originally,  2,251  voices  were  recorded  from  FAA  personnel.  It  was  extremely 
difficult  for  the  Technical  Center  to  unilaterally  find  the  number  and  diversity  of 
speakers  required  within  the  FAA  alone.  Subsequently,  an  additional  3,366  voices 
were  recorded  from  employees  of  the  Internal  Revenue  Service  and  Social  Security 
Administration  who  participated  in  the  data  collection.  Table  1  shows  the  number 
of  recorded  calls  by  location. 
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TABLE  1.  RECORDED  CALLS  FROM  PREDETERMINED  DIALECT  AREAS 
THROUGH  MARCH  7,  1981  (END  OF  PROGRAM) 


FAA 

IRS/Social  Security 

Total 

Chicago,  III. 

68 

235 

303 

Atlanta,  Ga. 

181 

239 

420 

Boston,  Mass. 

1S8 

77 

235 

Los  Angeles,  Calif. 

77 

278 

355 

Rochester/Syracuse,  N.Y. 

22 

74 

96 

Dayton/Columbus,  Ohio 

54 

97 

151 

Philadelphia,  Pa. 

101 

296 

397 

Labbock,  Tex. 

53 

26 

79 

Knoxville,  Tenn. 

38 

47 

85 

Metropolitan  N.Y.C. 

220 

256 

476 

Pittsburg,  Pa. 

95 

207 

302 

Charleston,  S.C. 

34 

38 

72 

Denver,  Colo. 

121 

75 

196 

Portland,  Oreg. 

141 

109 

250 

Kansas  City  Mo./Kans. 

174 

167 

341 

Little  Rock,  Ark. 

109 

104 

213 

Milwaukee,  Wis. 

91 

136 

227 

Richmond,  Va. 

50 

192 

242 

New  Orleans,  La. 

88 

88 

176 

Fort  Worth/Dallas,  Tex. 

155 

78 

233 

Miami,  Fla. 

57 

49 

106 

North  Carolina* 

— 

116 

116 

City  not  available** 

164 

382 

546 

TOTAL  CALLS 

2,251 

3,366 

5,617 

*A  special  effort  was  made  to  record  voices  from  the  coastal  areas 
of  North  Carolina  in  addition  to  those  locations  identified  in 
the  dialect  study. 


**Callers  did  not  indicate  the  city  they  were  calling  from 


PROCEDURE 


The  hardware  modifications  were  made  in  April  of  1980.  The  new  vocabulary  data 
base  and  recognition  software  were  installed  in  November  1980.  In  January  of  1981, 
initial  tests  were  conducted  in  which  subjects  filed  simulated  flight  plans 
directly  into  the  URD  over  the  telephone.  Fifteen  subjects  —  twelve  male  and 
three  female  —  from  the  Technical  Center  participated  in  the  initial  test. 
Fourteen  subjects  tested  were  inexperienced  users.  That  is  to  say,  they  were 
untrained  and  inexpert  in  talking  to  an  Utterance  Recognition  Device.  One  subject, 
experienced  in  talking  to  word  recognition  machines,  was  used  in  the  test  for  the 
purpose  of  comparison.  Three  of  the  subjects  were  general  aviation  pilots.  The 
subjects  differed  in  cultural  and  geographic  origin.  They  indicated  the  following 
geographic  areas  as  best  representing  their  accent:  West  Virginia,  New  York  City, 
Northern  Pennsylvania,  Virginia,  Southern  New  England,  South  Jersey,  Central  New 
York  State,  Philadelphia,  Upper  Ohio  Valley,  Central  Pennsylvania,  Southeastern 
Pennsylvania.  In  addition  to  the  above,  one  subject  identified  his  accent  as 
"General  American." 

Each  subject  entered  four  simulated  flight  plans:  two  VFR  and  two  IFR.  However, 
not  all  of  the  flight  plan  data  were  entered  by  voice  recognition.  As  would 
reasonably  be  expected,  the  requirement  to  spell  out  every  flight  plan  entry 
phonetically  reduces  the  attractiveness  of  computerized  word  recognition  or  any 
other  direct  character-by-character  entry  system  (i.e.,  Touch-Tone*  or  pilot 
self-briefing  terminal)  for  flight  plan  filing.  The  fact  is  that  even  at 
100  percent  accuracy,  the  protracted  length  of  the  transaction  seriously  diminishes 
the  attractiveness  of  filing  in  this  manner.  As  a  rule,  the  speech  channel  loses 
its  appeal  as  the  language  departs  more  and  more  from  natural  speech.  On  the  other 
hand,  by  handling  only  those  entries  that  are  sent  to  the  National  Airspace  System 
or  destination  Flight  Service  Station  by  machine  recognition  and  the  remaining 
entries  by  prompted  recording,  the  protocol  is  more  natural  and  compatible  with  the 
task  situation.  Using  the  standard  flight  plan  (FAA  Form  7233-1),  figures  1 
through  4  show  the  entries  in  the  teat  made  by  machine  recognition  and  those  made 
by  prompted  recording.  The  shaded  portion  of  each  flight  plan  indicates  the 
entries  made  by  voice  recognition.  The  unshaded  portion  indicates  the  entries  that 
were  recorded.  The  phonetic  alphabet,  the  digits  zero  through  niner,  plus  the 
numbers  "hundred"  and  "thousand"  and  a  set  of  control  words  were  used  for  making 
entries  by  voice  recognition.  The  recorded  entries  were  made  in  natural  language. 

To  illustrate  the  order  in  which  the  information  was  entered  and  the  structure  of 
the  dialogue,  a  verbatim  transcript  of  one  test  subject's  actual  transaction  is 
shown  in  figures  5  and  6.  Figure  5  is  the  protocol  used  for  a  VFR  flight  plan. 
Figure  6  shows  the  IFR  protocol.  The  user-computer  dialogue  has  a  resemblance  to 
normal  human  conversation.  This  enables  the  system  to  be  compatible  with  human 
cognitive  style. 

There  are  two  automatic  error  correction  routines  which  occur  when  "no"  is  received 
instead  of  "yes"  after  verification.  When  "no"  is  received  after  a  string  is 

entered,  the  URD  says  "Sorry,  try  again."  After  the  string  is  reentered  and  a 

"no"  received  again,  the  URD  says  "Sorry,  was  the  first  word  _ 7"  If  "yes,"  it 

says  "Was  the  next  _ 7"  If  "no,"  it  says  "What  was  it7"  If  the  answer  to  that 

was,  for  example,  "5,"  the  URD  will  say  "Did  you  say  57"  If  the  response  by  the 

caller  is  "yes,"  it  will  store  the  word  and  move  on  to  the  next,  etc.  If  the 

response  is  "no,"  it  will  eliminate  "5"  from  the  vocabulary  and  say  "What  did 
you  say7"  In  this  fashion,  it  will  soon  find  the  correct  word  as  long  as  "yes"  and 
"no"  are  properly  recognized. 
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CIVIL  AIRCRAFT  PILOTS.  FAR  Put  91  rtovlnt  you  file  an  IFR  flight  plan  to  opmti  und*t  inetrument 
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recommended  is  a  good  operating  practice.  See  alao  Part  99  for  requirement!  concerning  D V  FR  flight  plane. 


4.  TRUE 

5.  DEPARTURE  POINT 

AIRSPEED 

120 

DELAWARE  AIRPARK 

KTS 

7.  CRUISING 
AlTITUOE 


7  THOUSAND 
5  HUMORED 


DIRECT  COYLE  DIRECT  PROVIDENCE 
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COMPUTERIZED  WORD 
RECOGNITION 

TAPE  RECORDED 


tt.  remarks 


EE3E3  «EE 


i*  roeiow  ooaoo  u  alternate  Aineonnet  i«.  eiiort  name.  aoorem  a  tiiefhone  i 

Moone  minutes 

POSTON  (SUBJECTS  USED  THEIR  OWN) 


i  a  aircraft  homc  base  | is.  number 
NANTUCKET 


ie  coion  or  aircraft 

BROWN  O  GOLD 
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CLOSE  VFR  FUGHT  PLAN  WITH. 


FSS  ON  ARRIVAL 


FIGURE  1.  VFR  FLIGHT  PLAN  NUMBER  1 
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OIPARTMtNT  Or  TRANSPORTATION 
rtfOCRAC  AVIATION  AOMmilTH A T ION 

FLIGHT  PLAN 


CIVIL  AIRCRAFT  PILOTS.  FAR  Put  91  raquirea  you  (IN  an  IFR  flight  plan  to  opvrata  undo  inatrumant 
flight  rule*  in  controlled  alnpac*.  Fiiturv  to  foe  could  mult  In  •  civil  penalty  not  to  exceed  $ 1 .000  for  each 
violation  (Section  901  of  the  Federal  Aviation  Act  o(  1958,  a*  amended).  Filing  of  a  VFR  flight  plan  ia 
recommended  ae  a  good  operating  practice.  See  alto  Part  99  for  requirement!  concerning  DVFR  flight  plana. 


KEEP?! 


COMPUTERIZED  WORD 
RECOGNITION 


TAPE  RECORDED 


mamam  ■ 


14.  PILOT'S  MAMS,  AOOKISS  A  TEL1PHONS  NUMBS II  B  AlBCNAPT  HOMS  BASS 

IS.  NUMBER 
ABOAAO 

IgUBJECTI  USED  THEIR  OMNI 

N.  PHILADELPHIA 

is 

1.  COLO*  Of  AI*CftAPT 

whits  *  bluc 


CLOSE  VFR  FLIGHT  PLAN  WITH. 


FSS  ON  ARRIVAL 


TANGO  PAPA  alpha’* 
'  ENTER— « 


CIVILAIRCRAFT  PILpTS.  FAR  Part  9 1  requires  you  fit*  an  IFR  flight  plan  to  oporala  under  instrument 
flight  ruler  in  controlled  airspace.  Failure  to  fOe  could  reault  in  a  civil  penalty  not  to  exceed  Si. 000  for  each 
violation  (Section  901  of  the  Federal  Aviation  Act  of  I9SS,  aa  amended).  Filing  of  a  VFR  flight  plan  is 
recommended  as  s  good  operating  practice.  See  also  Part  99  for  requirements  concerning  D  V  FR  flight  plans. 


ta.  rutL  on  aoano 


14.  PtLOT-g  NAMt.  AOONESS  A  TILEPHONK  NUMBER  A  AlftCRAPT  HOME  BASE 
(SUBJECTS  USED  THEIR  OWNI  PHILADELPHIA 


IS.  COLOR  OS  AinCRAST 

ORANGE  A  BROWN 


CLOSE  VFR  FLIGHT  PLAN  WITH _ 


department  OP  transportation 


FLIGHT  PLAN 


13.  ALTERNATE  AIRPORT'S) 


ST.  PETERSBURG 


HOURS 


MINUTES 


FSS  ON  ARRIVAL 


FIGURE  4.  IFR  FLIGHT  PLAN  NUMBER  2 
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Computer:  Hallo,  tbi*  is  tbt  pilot  tutOMCtd  briefing  system.  Detailed  operating 
instructions  ara  availabla  (or  the  nev  or  occasional  uaar.  Do  you  wish 
da  tailed  operating  instruct iooaT  Plaaaa  aay  yaa  or  ao  iamdiately  after 
tha  cue-tone. 

Uaar:  Negative. 

Caaputer:  Say  briefing,  (ila.  aaand ,  apacialiat,  or  cloaa. 

User:  Pile. 

Computer:  Standby  to  apeak  your  flight  plaa  iwed  lately  after  tha  cua-tona.  Do  you 
wiah  to  file  a  VFI  flight  plan?  Say  affirmative  or  negative. 

Uaar:  Affirmative. 

Computer:  Did  you  aay  affirmative? 

Uaar:  Tea. 

Computer:  For  tha  following  eotriea,  uae  tha  phonetic  alphabet,  mabari,  and  tha 
worda  point,  alaat,  hundred a ,  ehouaanda.  and  enter.  All  entries  ara 
terminated  with  tha  word  entar.  Aftar  tha  laat  alament  of  tha  routa  of 
flight  bm  baaa  entered,  aay  the  word  enter  by  itself  to  proceed  with 
your  flight  plan.  You  meat  confirm  all  emtrine  by  eaying  affirmative 
or  negative.  Thera  will  ha  no  baep-tona  whan  tha  girl  aehe  a  question. 

Bntar  aircraft  call  oiffi. 

Uaar:  lovambar  Sevan  Three  gave a  Kilo. 

Computer:  Bov  amber  gevea  Three  Sava a  Pilot 

Dear:  Affirmative. 

Computer:  Continue. 

►— * 

O  User:  Upha  Bntar. 

Computer:  \lpha  Bntar f 

Uaar:  Affirmative. 

Computer:  Enter  aircraft  type. 

Ueer:  r**a  Alpha  Two  Bight  later. 

Computer:  Papa  Alpha  Two  Bight  Inter? 

Uaar:  Tea. 

Computer:  later  destination  identifier. 

User:  Alpha  Charlie  lilo  Inter. 

Compute?:  Alpha  Charlie  Kilo  BaterT 

Dear:  Affirmative. 

Computer:  later  propoeed  departure  time. 

Uaar:  One  Throe  Three  five  later. 

Camp at or:  One  Three  Three  five  later? 

leer:  Tea. 

Computer:  Bntar  net lan tad  time  ee  route. 

FIGURE  5.  V7R  PROTOCOL 


User:  Zero  Two  Pour  Five  Enter. 

Computer:  Zero  Two  Pour  Five  Inter? 

Uaer:  Tn. 

Computer:  The  following  information  ia  recorded  oo  audio  tape.  Plaaaa  uaa  natural 
apaach  whan  you  answer  tha  question.  A  silence  of  2  seconds,  after 
your  reeponae,  will  advance  you  to  the  next  question.  Enter  point  of 
departure. 

Uaer:  Delaware  Airperk. 

Computer:  Inter  true  airspeed. 

Uaar:  120. 

Computer:  Entar  altitude. 

Uaer:  ?  thousand,  5  hundred. 

Computer:  Bntar  special  equipment  coda. 

Uaar:  Tango. 

Computer:  Inter  routa  of  flight. 

Uaar:  Direct  Coyle  direct  Providence. 

Computer:  Inter  elternete  airport. 

Uaer:  hoe toe. 

Computer:  later  fuel  on  hoard. 

User.  A  hours  and  30  mi  nut as. 

Computer:  Inter  ouster  on  board. 

User:  2. 

Computer:  Bntar  color  of  aircraft. 

Uaar:  Brown  and  gold. 

Computer:  later  home  baaa. 

Uaar:  lantucket. 

Comp wear:  Bntar  pilot's  name,  oddraaa,  and  telephone  number. 

Uaar:  Subject' a  name,  oddraaa,  and  telephone  mabar. 

Computer:  later  remarks. 

Uaar:  BLT  O.K. 

Counter:  Tour  flight  plaa  km  boom  accepted  aad  filod.  Do  you  require  additional 
assistance* 

Uaar:  Begat ive. 

Computer:  Did  you  aay  negative? 

Uaar:  Toe. 

Comparer:  Thank  yen.  lave  a  good  day. 

(VERBATIM  TRANSCRIPT) 


Computer: 

User: 

Computer: 

User; 

Coaputtr: 

User: 
Computer : 
User: 
Coaputer: 


User: 

Computer : 

User: 

Computer; 

User: 

Computer: 

User: 

Computer: 

User: 

Computer : 

User: 

Cosiputer: 

User: 

Computer: 

User: 

Coaputer: 

User: 

Computers 

User: 

Ceaputer: 

User: 

Ceaputer: 

User: 

Coaputer: 

User: 

Coaputer: 

User: 

Ceaputer: 

User: 

Cempei  av i 

User: 

Ceaputer: 


Hello,  this  is  the  pilot's  automated  briefing  system.  Octsild  operetiog 
instruct  ions  sre  svailsble  for  the  new  or  occasional  user.  Do  you  wish 
detailed  operating  instructions?  Please  say  yes  or  no  immediately  after 
the  cue-tone. 

Negative. 

Say  briefing,  file,  amend,  specielist,  or  close. 

Pile. 

Standby  to  speak  your  flight  plan  imediately  after  the  cue-tone.  Do  you 
wish  to  file  s  VP1  flight  plan?  Say  affirmative  or  negative. 

Negative. 

Did  you  say  negative? 

Yes. 

For  the  following  entries,  use  the  phonetic  alphabet,  numbers,  and  the 
words  point,  slant,  hundreds,  thousands,  and  enter.  All  entries  sre 
terminated  with  the  word  enter.  After  the  last  elsaent  of  the  route  of 
flight  has  been  entered,  say  the  word  enter  by  itself  to  proceed  with 
your  flight  plan.  You  must  confirm  all  entries  by  saying  affirmative  or 
negative.  There  will  be  beep-tone  when  the  girl  esks  a  q uettion.  Enter 
aircraft  call  sign. 

Noves&er  Four  One  Zero  Whiskey. 

November  Pour  One  Zero  Whiskey? 

Affirmative. 

Cont inue. 

Bravo  Enter. 

Bravo  Enter? 

Yea. 

Enter  aircraft  type  and  special  equipment  code. 

Coif  Two  Slant  Foxtrot  Enter. 

Coif  Two  Slant  Foxtrot  Enter? 

Yes. 

Enter  destination  identifier. 

Tango  Papa  Alpha  Enter. 

Tango  Papa  Alpha  Enter? 

Yes. 

Enter  proposed  departure  time. 

Zero  Eight  Pive  Zero  Enter. 

Zero  Eight  Five  Zero  Enter? 

Yes. 

Enter  estimated  time  en  route. 

Zmro  Two  Two  Zero  Enter. 

Zero  Two  Two  Eero  Enter? 

Yes. 

Enter  true  airspeed. 

Four  Four  Zero  Enter. 

Pour  Four  Zero  Enter? 

Yea. 

Enter  departure  identifier. 

Tango  Tango  November  Inter. 

Tonga  Tomgs  Nevambi.  insert 


Yea. 

Knter  prepneed  altitude. 


Computer: 

User: 

Computer: 

Uaer: 

Computer: 

Uaer: 

Computer: 

Uaer: 

Computer: 

Uaer: 

Computer: 

Uaer: 

Computer: 

Uaer: 

Computer: 

Uaer: 

Computer : 

Uaer: 

Computer: 

Uaer: 

Computer: 

Uaer: 

Computer: 

Uaer: 

Computer: 

Uaer: 

Computer: 

Uaer: 

Computer: 

Uaer: 

Computer: 

Uaer: 

Cemputer: 

Uaer: 

Computer: 

Uaer: 

Computer: 

Uaer: 

Computer: 

Uaer: 

Computer: 

Uaer: 

Cemputer: 

Uaer: 

Computer: 


Enter  nest  route  element. 

Borneo  India  Charlie  Enter. 

Borneo  India  Charlie  Enter? 

Yea. 

Enter  next  route  element. 

Juliette  Pive  Two  Enter. 

Juliette  Pive  Two  Enter? 

Affirmative. 

Enter  next  route  element. 

Charlie  Alpha  Echo  Enter. 

Charlie  Alpha  Echo  Enter? 

Yea. 

Enter  next  route  element. 

Juliette  Seven  Pive  Enter. 

Juliette  Seven  North  Enter? 

Negat ive . 

Sorry  —  try  again. 

Juliette  Seven  Pive  Enter. 

Juliette  Seven  PiVe  Enter? 

Tea. 

Enter  next  route  element. 

Tango  Alpha  Yankee  Enter. 

Tango  Alpha  Yankee  Cnter? 

Yea. 

Enter  next  route  element. 

Juliette  One  One  Niner  Enter.  | 

Juliette  One  One  liner  Enter? 

Yea.  j 

Enter  next  route  element. 

Enter. 

Enter? 

Yea. 

Enter  remark  a. 

Alpha  Delta  Charlie  Uniform  Inter. 

Alpha  Delta  Charlie  Uniform  Enter? 
Affirmative. 

The  following  information  ia  recorded  on  aud 
speech  when  you  answer  the  question.  A  ail* 
response ,  wii l  advance  you  to  the  next  quest 

St.  Petersburg. 

Inter  fuel  on  hoard.  i 

A  hours . 

Enter  number  on  board. 

10.  j 

MR  cotvr  mt  aircraft. 

Or  MR.  ni  tram, 
lata  hM»  tear. 


detailed  operating  instruction*?  Please  say  yes  or  no  lossvdiately  alter 
the  cue- tone. 

User:  Negative. 

Computer :  Say  briefing,  file,  aaciW,  specialist,  or  close. 

User:  Pile. 

Computer:  Standby  to  speak  your  flight  plan  lMediatvly  after  the  cue-tone.  Do  you 
wish  to  file  a  VP*  flight  plan?  Say  affirmative  or  negative. 

User;  Negative. 

Computer:  Did  you  say  negative? 

User:  fee- 

Computer:  Por  the  following  entries,  use  the  phonetic  alphabet,  numbers,  and  the 
words  point,  slant,  hundreds,  thousand*,  and  enter.  All  entries  are 
terminated  with  the  word  enter.  After  the  iaat  element  of  the  route  of 
flight  has  been  entered,  say  the  word  enter  by  itself  to  proceed  with 
your  flight  plan.  You  must  confirm  alt  entries  by  saying  affirmative  or 
negative.  There  will  be  beep-tone  when  the  girl  asks  a  question.  Enter 
aircraft  call  sign. 

User:  November  Pour  One  Zero  Whiskey. 

Computer:  November  Four  One  Zero  Whiskey? 

User:  Affirmative- 

Computer:  Continue. 

User:  Bravo  Enter. 

Computer:  Bravo  Enter? 

User:  Yes- 

Computer:  Enter  aircraft  type  and  special  equipment  code. 

User:  Coif  Two  Slant  Postrot  Enter. 

Computer;  Coif  Two  Slant  Postrot  Eater? 

User:  Yes. 

Computer:  Enter  destination  identifier. 

User:  Tsngo  Papa  Alpha  Enter. 

Computer:  Tango  papa  Alpha  Entar? 

User:  Yes. 

Computer:  Enter  proposed  departure  time. 

User:  Zero  Eight  Five  Zero  Enter. 

Computer:  Zero  Eight  Five  Zero  Enter? 

User:  Yes. 

Computer;  Enter  estimated  time  *n  route. 

User;  Zero  Two  Two  Zero  Entar. 

Computer:  Zero  Two  Two  Zero  Enter? 

User;  Yes. 

Computer:  Entar  true  airspeed. 

User:  Pour  Pour  Zaro  Ent*r. 

Computer:  Pour  Pour  Zero  Enter? 

User  Yes. 

Computer:  Enter  departure  identifier. 

User:  Tango  Tango  November  Enter. 

Camp  ■ter-.  Tango  Tanga  November  Inter? 

User.  To*. 

Computer:  inter  prepossd  altitude. 

User:  Three  Niaer  torn  Enter. 

C  limp  liter:  Thre*  liner  loro  inter? 

User:  Ye*. 

Computer:  There  is  no  preferred  route  for  your  entry?  Enter  first  route  element. 
User.  Tango  Tango  loves** r  Two  Enter. 

Computer  Tango  Tango  November  Two  Enter? 

User :  Tea . 


User:  Borneo  India  Charlie  Enter. 

Computer:  Borneo  India  Charlie  Entar? 

Heart  Yes. 

Computer:  Eater  nest  route  element. 

User;  Juliette  Five  Two  Enter. 

Computer:  Juliette  Five  Two  Enter? 

User:  Affirmative. 

Computer:  Enter  next  route  element. 

User:  Charlie  Alpha  Echo  Enter. 

Computer:  Charlie  Alpha  Echo  Enter? 

User:  Yes. 

Computer:  Enter  next  route  clement. 

User:  Juliette  Seven  Five  Enter. 

Cotsputer;  Juliette  Seven  North  Enter? 

User:  Negative. 

Computer:  Sorry  —  try  again, 
liter:  Juliette  Seven  Five  Enter. 

Computer:  Juliette  Seven  FiVe  Enter? 

User:  Yes. 

Computer:  Enter  next  route  olement. 

User:  Tango  Alpha  Yankee  Enter. 

Computer:  Teogo  Alpha  Yankee  Eater? 

User:  Yes. 

Computer:  Enter  next  route  element. 

User:  Julietta  One  One  Miner  Eater. 

Computer:  Juliette  One  One  Niaer  Enter? 

User:  Tea. 

Computer:  Enter  next  rout#  element. 

User:  Eater. 

Computer:  Enter? 

User:  Yes. 

Computer:  Eater  remarks. 

User:  Alpha  Delta  Charlie  Uniform  Enter. 

Computer;  Alpha  Delta  Charlie  Uniform  Enter? 

User:  Affirmative. 

Computer:  The  following  ini  .motion  is  recorded  on  audio  tape.  Please  u*«  natural 
speech  when  you  answer  the  question.  A  silence  of  2  seconds,  after  your 
response,  will  advance  you  to  the  next  question.  Enter  slternste  airport. 

User:  St.  Petersburg. 

Computer:  Enter  fuel  on  board. 

User;  4  hour*. 

Computer:  Enter  number  on  board. 

Uaer:  10. 

Computer:  Eater  color  of  aircraft. 

User:  Orange  and  brown. 

Computer:  Enter  hem*  base. 

User:  Philadelphia. 

Computer:  Enter  pilot's  naaw ,  address,  and  telephone  number. 

User:  Subject's  naam ,  address,  and  telephone  number. 

Computer;  Your  flight  plan  hae  been  excepted  and  filed.  Do  you  require  additional 
assistance? 

User:  Negative. 

Computer:  Thank  you.  Have  a  good  day. 


FIGURE  6.  IFR  PROTOCOL  (VERBATIM  TRANSCRIPT) 


RESULTS 


INITIAL  TESTS. 

Table  2  summarizes  the  results  of  the  initial  test.  The  numbers  in  column  2,  Total 
Words  Spoken,  are  the  total  number  of  words  spoken  by  the  subject  in  entering  all 
four  flight  plans.  Column  3,  Please  Repeat,  shows  the  number  and  percentage  of 
utterances  that  were  unrecognized  by  the  computer.  This  occurred  when  the  computer 
could  not  make  an  identification  and  therefore  asked  for  a  repeat  speech  sample. 
Column  4  reflects  the  number  and  percentage  of  misrecognized  words.  Not  all 
unrecognized  and  misrecognized  words  were  due  to  system  error.  A  significant 
amount  were  a  result  of  user  errors,  such  as  speaking  words  that  were  not  in  the 
vocabulary  data  base,  speaking  two  or  more  words  at  a  time,  not  confirming  an  entry 
with  a  "yes''  or  a  "no,"  speaking  before  the  cue-tone,  etc.  Nevertheless,  the 
siajority  of  misrecognitions  were  the  result  of  system  error.  Column  5  shows  the 
accuracy  of  the  flight  plans  as  finally  completed  after  corrections.  The  percent 
of  accuracy  was  determined  by  dividing  the  number  of  words  recognized  correctly  by 
the  nuaiber  of  words  in  the  flight  plans.  As  reflected  in  Column  5,  ten  out  of  the 
fifteen  subjects  were  able  to  file  flight  plans  (two  VFR  and  two  IFR)  that  were 
100  percent  accurate.  The  flight  plan  accuracy  attained  by  the  other  five  subjects 
ranged  from  93.2  to  99.4  percent.  The  total  number  of  words  spoken  by  the  subjects 
shown  in  Column  2  exceeds  the  number  of  words  in  the  flight  plans  as  shown  in 
Column  5.  The  reason  for  this  is  that  each  entry  must  be  confirmed  with  a  "yes"  or 
a  "no"  (affirmative  or  negative).  It  is  important  to  note  that  the  overall 
accuracy  after  corrections  for  all  of  the  flight  plans  combined  was  99  percent. 

Tables  3  through  17  show  the  results  obtained  by  each  subject  for  each  flight  plan. 
The  subject  numbers  correspond  to  the  numbers  shown  in  table  2,  Summary  of  Initial 
Test  Result  a. 

Table  18  shows  the  time  taken  for  each  subject  to  complete  each  of  the  four  flight 
plans.  It  should  be  pointed  out,  however,  that  the  time  necessary  to  complete  a 
flight  plan  could  be  substantially  reduced  by  shortening  the  interval  between 
cue-tones  and  prompts,  and  by  eliminating  the  long  explanatory  message. 

Table  19  identifies  the  words  that  were  misrecognized  more  than  once.  These  are 
listed  in  column  1.  Column  2  shows  the  words  they  (the  misrecognized  words  in 
column  1)  were  confused  with.  Column  3  lists  the  number  of  times  the  words 
were  confused.  Column  4  identifies  the  speaker  (by  number)  of  the  misrecognized 
word.  The  speaker  numbers  shown  in  column  4  correspond  to  the  subject  numbers  in 
table  2. 

As  shown  in  table  19,  the  system  misrecognized  the  word  "affirmative"  and  confused 
it  with  "negative"  seven  times.  The  word  "negative"  was  misrecognized  and  confused 
with  "affirmative"  five  times.  The  "ative"  sound  patterns  are  nearly  identical  in 
both  words.  "Yes"  was  misrecognized  and  confused  with  "no"  six  times,  while  "no" 
was  confused  with  "yes"  twice.  There  are  methods,  however,  for  reducing  this  type 
of  confusion,  especially  when  there  are  only  four  possible  words  expected. 

As  reflected  in  table  19,  the  word  "eight"  was  confused  with  six  other  words. 
"Eight"  is  a  confusable  word  with  all  recognition  techniques.  It  is  a  low  energy 
word,  especially  if  spoken  without  a  clear  "t"  plosive  sound  at  the  end.  The 
word  "enter"  was  also  confused  with  a  number  of  words;  particularly  with  the  word 
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"attention."  Five  different  speakers  confused  it  with  "attention"  eight  times. 
The  test  results  showed  that  "enter"  was  recognized  much  more  readily  when  the  "t" 
was  given  a  little  emphasis.  The  word  "five"  was  confused  with  "Miice"  five  times 
by  three  speakers.  The  "  f  ive" /"Mike"  confusion  is  a  common  one  and  will  b-.1 
difficult  to  overcome.  The  "November"  confusions  suggest  that  something  is  wronji 
with  the  "November"  reference  pattern.  This  can  probably  be  corrected.  It  can  be 
seen  from  examining  column  4  of  table  19  that  subject  number  13  and  15  contributed 
a  disproportionate  number  of  misrecognitions . 

The  confusion  between  "affirmative"  and  "negative"  or  between  "yes"  and  "no"  often 
led  to  a  chain  reaction  of  other  errors  due  to  the  nature  of  the  correction 
routine.  If  "yes"  was  confused  with  "no,"  the  correct  word  was  temporarily 
eliminated  from  the  vocabulary  thus  causing  a  series  of  other  mistakes.  The 
excerpt  below,  from  an  actual  transaction,  will  illustrate  this  problem.  Because 
"yes"  was  confused  with  "no,"  the  correct  word  "November"  was  temporarily 
eliminated  from  the  vocabulary.  The  system  then  made  the  next  best  choice  from  a 
set  of  word  patterns  that  did  not  include  the  pattern  for  November.  Thus,  further 
errors  occurred  until  the  completion  of  the  correction  cycle,  at  which  time  the 
pattern  for  November  was  reentered  in  the  vocabulary. 


Computer 

User 

Computer 

User 

Computer 

User 

Computer 

User 

Computer 

User 

Computer 

User 

Computer 

User 

Computer 

User 

Computer 

User 

Computer 

User 

Computer 

User 

Computer 

User 

Computer 

User 

Computer 

User 

Computer 

User 

Computer 


Enter  aircraft  call  sign. 

Romeo  Alpha  November  Two  Seven. 

Romeo  Alpha  November  Two  Attention? 

No. 

Sorry!  Try  again. 

Romeo  Alpha  November  Two  Seven. 

Romeo  Alpha  November  Two  Attention? 

No. 

I'm  sorry!  Was  your  first  word  Romeo? 
Yes. 

Was  the  next  Alpha? 

Yes. 

Was  the  next  November? 

Yes . 

What  was  it? 

November. 

Did  you  say  Hotel? 

No. 

What  did  you  say? 

November. 

Did  you  say  Lima? 

No. 

Enter  aircraft  call  sign. 

Romeo  Alpha  November  Two  Seven. 

Romeo  Alpha  November  Two  X-ray? 

No. 

Sorry!  Try  again. 

Romeo  Alpha  November  Two  Seven. 

Romeo  Alpha  November  Two  Seven? 

Yes. 

Cont inue . 
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TABLE  2. 


SUMMARY  OP  INITIAL  TEST  RESULTS 


Total  Words  Please  '  Misrecognized  Accuracy  of  Flight  Plans 

Spoken  Repeat  Words  After  Corrections 

No.  of  Words  Correct/ 


No. 

No. 

Percent 

No. 

Percent 

No.  of  Words  in  FP 

Percent 

1. 

Experienced 

242 

1 

0.41 

1 

0.41 

177/177 

100 

2. 

Inexperienced 

247 

2 

0.81 

0 

0.00 

177/177 

100 

3. 

Inexperienced 

266 

2 

0.75 

5 

1.88 

177/177 

100 

4. 

Inexperienced 

271 

1 

0.37 

8 

2.95 

177/177 

100 

5. 

Inexperienced 

265 

5 

1.89 

6 

2.26 

177/177 

100 

6. 

Inexperienced 

274 

3 

1.09 

9 

3.28 

177/177 

100 

7. 

Inexperienced 

291 

1 

0.34 

13 

4.47 

177/177 

100 

8. 

Inexperienced 

279 

3 

1.08 

11 

3.94 

176/177 

99.44 

9. 

Inexperienced 

308 

1 

0.32 

17 

5.52 

174/174 

100 

10. 

Inexperienced 

330 

4 

1.21 

20 

6.06 

177/177 

100 

11. 

Inexperienced 

328 

8 

2.44 

18 

5.49 

177/177 

100 

12. 

Inexperienced 

318 

4 

1.26 

25 

7.86 

169/177 

95.48 

13. 

Inexperienced 

351 

5 

1.42 

29 

8.26 

175/177 

98.87 

14. 

Inexperienced 

357 

8 

2.24 

33 

9.24 

175/177 

98.87 

15. 

Inexperienced 

347 

il 

3.75 

31 

8.93 

165/177 

93.22 

Totals 

4,474 

61 

1.36 

226 

5.05 

2627/2652 

99.06 

t 


TABLE  3.  SUBJECT  NUMBER  1  (EXPERIENCED  USER) 


Total  Words 
Spoken 

Please 

Repeat 

Misrecognized 

Words 

Accuracy  of  Flight  Plans 

After  Corrections 

Flight 

Plan 

No. 

No. 

Percent 

No. 

Percent 

Percent  of  Words  Correct/ 
No.  of  Words  in  FP 

Percent 

Time 
Min: Sec 

VFR-1 

37 

0 

0.00 

0 

0.00 

26/26 

100 

4:12 

VFR-2 

34 

0 

0.00 

0 

0.00 

24/24 

100 

4:04 

IFR-1 

77 

1 

1.30 

1 

1.30 

53/53 

100 

6:01 

1FR-2 

94 

0 

O.OC 

0 

o.co 

74/74 

100 

7:27 

Total 

242 

1 

0.41 

1 

0.41 

177/177 

100 

_ 

I 


TABLE  4.  SUBJECT  NUMBER  2  (INEXPERIENCED  USER) 


Total  Words 
Spoken 

Please 

Repeat 

Misrecognized 

Words 

Accuracy  of  Flight  Plans 

After  Corrections 

Flight 

Plan 

Ho. 

No. 

Percent 

No 

Percent 

Percent  of  Words  Correct/ 
No.  of  Words  in  FP 

Percent 

Tine 
Min: Sec 

VFR-1 

38 

0 

0.00 

0 

0.00 

26/26 

100 

4:29 

VFR-2 

35 

0 

0.00 

0 

0.00 

24/24 

100 

4:12 

IFR-1 

72 

1 

1.39 

0 

0.00 

53/53 

100 

5:51 

IFR-2 

102 

1 

0.98 

0 

0.00 

74/74 

100 

6:58 

Total 

247 

2 

0.81 

0 

0.00 

177/177 

100 

— 

TABLE  5.  SUBJECT  NUMBER  3  (INEXPERIENCED  USER) 


Total  Words 
Spoken 

Please 

Repeat 

Misrecognized 

Words 

Accuracy  of  Flight  Plans 

After  Corrections 

Plight 

Plan 

No. 

No. 

Percent 

No. 

Percent 

Percent  of  Words  Correct/ 
No.  of  Words  in  FP 

Percent 

VFR-1 

53 

1 

1.89 

3 

5.66 

26/26 

100 

VFR-2 

37 

0 

0.00 

0 

0.00 

24/24 

100 

IFR-1 

82 

1 

1.22 

2 

2.44 

53/53 

100 

IFR-2 

94 

0 

0.00 

0 

0.00 

74/74 

100 

Total 

266 

2 

0.75 

5 

1.88 

177/177 

100 

TABLE  6.  SUBJECT  NUMBER  4  (INEXPERIENCED  USER) 


Total  Words 
Spoken 

Please 

Repeat 

Misrecognized 

Words 

Accuracy  of  Flight  Plans 

After  Corrections 

Flight 

Plan 

No. 

No.  Percent 

No.  Percent 

Percent  of  Words  Correct/ 

No.  of  Words  in  FP  Percent 

TABLE  7 


SUBJECT  NUMBER  5  (INEXPERIENCED  USER) 


Total  Words 
Spoken 

Please 

Repeat 

Misrecognized 

Words 

Accuracy  of  Plight  Plans 

After  Corrections 

No. 

No. 

Percent 

No, 

Percent 

Percent  of  Words  Correct/ 
No.  of  Words  in  FP 

Percent 

49 

2 

4.08 

2 

4.08 

26/26 

100 

32 

0 

0.00 

0 

0.00 

24/24 

100 

83 

2 

2.41 

3 

3.61 

53/53 

100 

101 

1 

0.99 

1 

0.99 

74/74 

100 

265 

5 

1.89 

6 

2.26 

177/177 

100 

TABU  8.  SUBJECT  NUMBER  6  (INEXPERIENCED  USER) 


Total  Words 
Spoken 

No. 


Please 

Repeat 


No.  Percent 


Misrecognised 

Words 


No.  Percent 


Accuracy  of  Flight  Plans 
After  Corrections 


Percent  of  Words  Correct/ 
No.  of  Words  in  FP 


Percent 


TABLE  9.  SUBJECT  HUMBER  7  ( INEXPERIENCED  USER) 


Total  Words 
Spoken 

Please 

Repeat 

Misrecogniaed 

Words 

Accuracy  of  Flight  Plans 
After  Corrections 

Ho. 

Ho. 

Percent 

Ho, 

Percent 

Percent  of  Words  Correct / 
Ho.  of  Words  in  FP 

Percei 

55 

0 

0.00 

3 

5.45 

26/26 

100 

37 

0 

0.00 

3 

8.11 

24/24 

100 

74 

0 

0.00 

1 

1.35 

53/53 

100 

125 

1 

0.80 

6 

4.80 

74/74 

100 

291 

1 

0.34 

13 

4.47 

177/177 

100 

Tine 
Min: Sec 

5:08 

4:73 

5:39 

8:17 


< 


TABLE  11.  SUBJECT  NUMBER  9  (INEXPERIENCED  USER) 


Total  Word*  Pleaae  Miarecognized  Accuracy  of  Flight  Plana 


Spoken 

Repeat 

Word  a 

After  Correct iona 

A 

Flight 

Plan 

No. 

Ho. 

Percent 

Mo. 

Percent 

Percent  of  Worda  Correct/ 
No.  of  Worda  in  FP 

Percent 

Tiae 
Min: Sec 

|S) 

VFR-1 

51 

0 

0.00 

2 

3.92 

26/26 

100 

4:54 

U> 

VFR-2 

40 

0 

0.00 

1 

2.50 

24/24 

100 

4:22 

IFR-l 

105 

0 

0.00 

9 

8.57 

53/53 

100 

7:25 

XFR-2 

112 

1 

0.89 

5 

4.46 

71/71 

100 

8:22 

J 

J 

Total 

308 

1 

0.32 

17 

5.52 

174/174 

100 

_ 

! 


t. 
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TABLE  12.  SUBJECT  NUMBER  10  (INEXPERIENCED  USER) 


Total  Words 
Spoken 

Please 

Repeat 

Misrecognized 

Words 

Accuracy  of  Flight  Plans 

After  Corrections 

Flight 

Plan 

Ho. 

No. 

Percent 

No. 

Percent 

Percent  of  Words  Correct/ 
No.  of  Words  in  FP 

Percent 

Time 
Min: Sec 

VFR-1 

51 

2 

3.92 

2 

3.92 

26/26 

100 

5:31 

VFR-2 

40 

0 

0.00 

2 

5.00 

24/24 

100 

4:39 

IFR-1 

128 

0 

0.00 

14 

10.94 

53/53 

100 

9:17 

IFR-2 

111 

2 

1.80 

2 

1.80 

74/74 

100 

7:53 

" 

Total 

330 

4 

1.21 

20 

6.06 

177/177 

100 

— 

TABLE  13.  SUBJECT  NUMBER  11  (INEXPERIENCED  USER) 


Total  Word* 
Spoken 


Please  Misrecognized  Accuracy  of  Flight  Plans 

Repeat  Words  After  Corrections 


Percent 


Percent 


Percent  of  Words  Correct/ 
No.  of  Words  in  FP _ 


Percent 


TABLE  14.  SUBJECT  NUMBER  12  (INEXPERIENCED  USER) 


Total  Words 
Spoken 

Please 

Repeat 

Misrecognized 

Words 

Accuracy  of  Flight  Plans 

After  Corrections 

No. 

No .  Percent 

No.  Percent 

Percent  of  Words  Correct/ 

No.  of  Words  in  FP  Percent 

TABLE  15.  SUBJECT  NUMBER  13  (INEXPERIENCED  USER) 


Total  Words 
Spoken 

Please 

Repeat 

Misrecognized 

Words 

Accuracy  of  Flight  Plans 

After  Corrections 

Plight 

Plan 

Ho. 

No. 

Percent 

No, 

Percent 

Percent  of  Words  Correct/ 
No.  of  Words  in  FP 

Percent 

Tine 
Min: Sec 

VPR-1 

79 

2 

2.53 

11 

13.92 

26/26 

100 

6:49 

VFR-2 

54 

l 

1.85 

7 

12.96 

23/24 

95.83 

5:15 

IPR-l 

72 

0 

0.00 

1 

1.39 

53/53 

100 

5:42 

IPR-2 

146 

2 

1.37 

10 

6.85 

73/74 

98.65 

9:50 

Total 

351 

5 

1.42 

29 

8.26 

175/177 

98.87 

1 

\ 


TABLE  16.  SUBJECT  NUMBER  14  (INEXPERIENCED  USER) 


Total  Words 
Spoken 

Please 

Repeat 

Misrecognized 

Words 

Accuracy  of  Flight  Plans 

After  Corrections 

Flight 

Plan 

No. 

No. 

Percent 

No, 

Percent 

Percent  of  Words  Correct/ 
No.  of  Words  in  FP 

Percent 

VFR-1 

77 

2 

2.60 

10 

12.99 

26/26 

100 

VFR-2 

40 

1 

2.50 

1 

2.50 

24/24 

100 

IFR-1 

94 

0 

0.00 

7 

7.45 

52/53 

98.11 

IFR-2 

146 

5 

3.42 

il 

10.27 

73/74 

98.65 

Total 

357 

8 

2.24 

33 

9.24 

175/177 

98.87 

Time 
Min: Sec 

7:03 

4:31 

7:13 

10:15 
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TABLE  17.  SUBJECT  NUMBER  15  (INEXPERIENCED  USER) 


Total  Words 
Spoken 

Please 

Repeat 

Misrecogniged 

Words 

Accuracy  of  Flight  Plans 

After  Corrections 

Flight 

Plan 

No. 

No. 

Percent 

No, 

Percent 

Percent  of  Words  Correct/ 
No.  of  Words  in  FP 

Percent 

Tine 
Min: Sec 

VFR-1 

69 

7 

10.14 

17 

24.64 

19/26 

73.08 

6:52 

VFR-2 

34 

1 

2.94 

0 

0.00 

23/24 

95.83 

4:44 

IFR-1 

115 

3 

2.61 

7 

6.09 

53/53 

100 

»:ll 

IFR-2 

U9 

2 

1.55 

JL 

5.43 

70/74 

94.59 

10:10 

Total 

347 

13 

3.75 

31 

8.93 

165/177 

93.22 

_ 

TABLE  18.  TIME  TAKEN  TO  COMPLETE  FLIGHT  PLANS 


User 

VFR-1 
(min: sec) 

VFR-2 
(min: sec) 

IFR-1 
(min: sec) 

IFR-2 
(min: sec) 

1. 

Experienced 

4:12 

4:04 

6:01 

7:27 

2. 

Inexperienced 

4:29 

4:12 

5:51 

6:58 

3. 

Inexperienced 

5:09 

4:09 

5:56 

8:29 

4. 

Inexperienced 

4:42 

4:32 

5:39 

8:18 

5. 

Inexperienced 

5:09 

4:19 

6:38 

7:30 

6. 

Inexperienced 

4:27 

4:38 

7:08 

8:53 

7. 

Inexperienced 

5:08 

4:23 

5:39 

8:17 

8. 

Inexp>>  -ienced 

4:49 

4:50 

6:52 

7:57 

9. 

Inexpe  ienced 

4:54 

4:22 

7:25 

8:22 

10. 

Inexperienced 

5:31 

4:39 

9:17 

7:53 

11. 

Inexperienced 

5:24 

5:08 

8:14 

8:44 

12. 

Inexperienced 

5:41 

4:30 

7:30 

7:45 

13 

Inexperienced 

6:49 

5:15 

5:42 

9:50 

14. 

Inexperienced 

7:03 

4:31 

7:13 

10:15 

15. 

Inexperienced 

6:52 

4:44 

9:11 

10:10 

Average  Time 

5:21 

4:33 

6:57 

8:27 

30 


TABLE  19 


I 

WORDS  MISRE COGNIZED  MORE  THAN  ONCE 


Words  Misrecognired 
More  Than  Once 

Confused 

With 

No.  of 
Times 

Speaker 

No. 

Affirmative 

Negative 

7 

8,  11,  14, 

Affirmative 

X-ray 

2 

14 

Alpha 

Delta 

1 

13 

Alpha 

Papa 

2 

15 

Alpha 

Uniform 

1 

8 

Alpha 

Whiskey 

1 

11 

Alpha 

X-ray 

2 

11 

Alpha 

Six 

1 

14 

Alpha 

Hundred 

1 

14 

Bravo 

Lima 

2 

6 

Bravo 

Papa 

1 

6 

Delta 

Alpha 

4 

15 

Delta 

Thousand 

1 

6 

Echo 

Hotel 

1 

10 

Echo 

Kilo 

1 

10 

Echo 

Tango 

1 

4 

Eight 

Enter 

1 

13 

Eight 

Juliette 

2 

13 

Eight 

Lima 

2 

14 

Eight 

Victor 

8 

4,  7,  14,  1 

Eight 

Yankee 

1 

8 

Eight 

Six 

5 

7 ,  6 

Enter 

Attention 

8 

4,  7,  9,  1 

Enter 

Alpha 

2 

4,  7 

Enter 

Echo 

1 

15 

Enter 

November 

2 

9 

Enter 

Papa 

1 

7 

Enter 

Tango 

2 

9,  14 

Enter 

Uniform 

2 

7 ,  8 

Enter 

Victor 

5 

9.  13,  1 

Enter 

X-ray 

1 

14 

Enter 

Six 

1 

2 

Enter 

Seven 

1 

13 

File 

Specialist 

1 

13 

Five 

Echo 

1 

14 

Five 

Foxtrot 

2 

8,  2 

Five 

Hotel 

1 

2 

Five 

Nike 

S 

2,  12,  1 

Five 

Nine 

1 

7 

Five 

Oscar 

1 

12 

Five 

Point 

1 

8 

Five 

Victor 

2 

13,  15 

Five 

Whiskey 

l 

12 

Five 

One 

3 

4,  12 

Five 

Four 

1 

11 

Five 

Nine 

1 

4 

Four 

Tango 

1 

8 

Four 

Victor 

1 

11 

Juliette 

India 

1 

14 

Juliette 

Slant 

2 

14 

Juliette 

Uniform 

1 

19 

Juliette 

Three 

1 

7 

Juliette 

Nine 

1 

11 

Kilo 

Zero 

2 

2 

Kilo 

Hundred 

1 

14 

Negative 

Affirmative 

5 

9,  U, 

Negative 

Affirmative 

2 

6,  13 

November 

Attention 

1 

3 

November 

Echo 

1 

8 

November 

Inter 

1 

2 

.  November 

Hotel 

1 

9 

Noveaber 

Kilo 

1 

3 

November 

Lima 

1 

9 

November 

Uniform 

6 

10,  15 

November 

Victor 

2 

11,  14 

COMPUTER  VOICE. 


The  system  communicated  with  the  user  through  stored  human  speech.  The  users  found 
the  voice  to  be  friendly,  polite,  and  assuring.  It  should  be  remembered  that 
recognition  failure  can  cause  the  user  to  become  frustrated  and  to  lose  confidence 
in  the  system.  If  the  voice  used  by  the  system  can  reduce  frustration,  then  it 
seems  advisable  to  provide  user-friendly  dialogue. 

COMPARISON  OF  OLD  AMD  NEW  REFERENCE  PATTERNS. 

The  old  data  base  consisted  of  500  voices  saying  the  digits,  the  words  "yes"  and 
"no,"  and  300  voices  saying  the  other  words.  No  attempt  was  made  to  build  the 
capability  to  handle  variations  in  pronunciation  due  to  speaker  dialects  into  the 
recognition  algorithm.  On  the  other  hand,  the  new  data  base  included  the  broad 
range  of  dialectal  variation,  as  pointed  out  by  the  dialect  study.  Thus,  the  new 
recognition  algorithm  was  constructed  from  a  larger,  more  universal,  and  organized 
data  base.  Tables  20  through  23  compare  the  results  of  entering  a  test  set  of 
200  voices  as  entered  against  the  old  and  new  reference  patterns.  It  is  important 
to  note  that  this  test  set  of  200  voices  was  not  used  in  the  construction  of 
reference  patterns,  and  was  selected  across  recorded  dialects.  Since  the  test  set 
included  a  broad  range  of  American  dialectal  variation,  it  was  considered  to  be  a 
reliable  gauge  for  estimating  how  well  the  system  might  perform  on  a  nationwide 
basis.  In  each  confusion  sutrix,  the  test  set  is  represented  by  the  vertical 
column  and  the  data  base  by  the  horizontal.  The  figures  in  the  matrix  represent 
the  percentage  of  correct  recognitions  to  one-tenth  of  one  percent;  i.e.,  926  is 
92.6  percent. 


Examination  of  tables  20  through  23,  shows  the  following  results: 


Old  Data  Base 


North,  South,  East,  West,  Local  91.28Z 
File,  Specialist,  Briefing,  Amend,  Close  92.15Z 
Affirmative,  Negative,  Yes,  No  98.55Z 
Zero  through  Nine,  Yes,  No  92.28Z 


New  Data  Base 
97.23Z 
96.48Z 
97.94Z 
94.03Z 


With  the  exception  of  the  subset  (affirmative,  negative,  yes,  no),  the  new 
reference  patterns  recorded  a  notable  increase  in  recognition  accuracy  over  the  old 
patterns.  The  use  of  a  linguistically  more  complete  data  base  in  the  new  system 
also  promotes  the  probability  that  it  is  better  adapted  to  a  wider  representation 
of  the  United  States  population.  Upon  closer  inspection  of  table  22,  we  find  that 
there  is  a  reduction  in  accuracy  of  1.1  percent  for  the  words  "yes”  and  "no"  in  the 
new  data  base  as  compared  to  the  old.  This  indicates  a  need  to  reexamine  the 
reference  pattern  for  these  words. 
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Nevertheless,  it  would  be  reasonable  to  assume,  judging  from  tables  20  through  23, 
that  the  improvements  in  accuracy,  with  the  new  data  base,  would  raise  the 
performance  of  the  Mass  Ueather  Dissemination  Engineering  Model  to  a  level  quite 
satisfactory  for  the  general  pilot  population.  In  this  model,  only  the  following 
three  active  vocabularies  would  be  used: 

1.  "North,  South,  East,  West,  and  Local"  (97.2  percent  accurate) 

2.  "Yes,  No,  Affirmative,  and  Negative"  (97.9  percent  accurate) 

3.  "File,  Briefing,  Specialist,  Close,  and  Amend"  (96.5  percent  accurate) 

Tables  24  and  25  show  the  recognition  accuracy  of  the  words  in  the  phonetic 
alphabet  as  they  might  be  used  in  larger  groups.  While  the  overall  accuracy 
is  good,  some  of  the  words  have  relatively  high  confusion  rates,  such  as  "zero" 
and  "kilo"  as  shown  in  table  25.  It  also  appears  that  "enter"  may  not  be  the  best 
choice  for  a  terminator  since  it  has  an  appreciable  correlation  with  almost  all  the 
words  in  table  25  (see  last  column).  Other  terminators,  such  as  the  word  "stop"  or 
the  use  of  silence  might  produce  better  results. 
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TABLE  20.  COMPARISON  BETWEEN  OLD  AND  NEW  REFERENCE  PATTERN 
FOR  DIRECTION  CONTROL  WORDS 


Old 


North 

South 

East 

West 

Local 

North 

926 

5 

22 

5 

39 

South 

22 

778 

79 

0 

119 

East 

23 

0 

960 

0 

15 

West 

11 

0 

23 

959 

5 

Local 

29 

5 

11 

0 

953 

91.28Z  recognized  as  correct  word. 


New 


North 

South 

East 

Local 

th 

952 

5 

23 

0 

17 

th 

5 

970 

5 

0 

17 

t 

0 

8 

983 

0 

8 

c 

5 

0 

23 

970 

0 

ll 

6 

0 

6 

0 

987 

97.23Z  recognized  as  correct  word. 
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TABLE  21 


COMPARISON  BETWEEN  OLD  AND  NEW  REFERENCE  PATTERNS 
(FILE,  SPECIALIST,  BRIEFING,  AMEND,  CLOSE) 


Old 


File 

Specialist 

Briefing 

Amend 

Close 

File 

964 

17 

0 

5 

11 

Specialist 

0 

947 

35 

0 

17 

Briefing 

0 

11 

938 

28 

22 

Amend 

0 

101 

0 

790 

107 

Close 

16 

5 

5 

11 

961 

92.15* 

recognized  as 

correct  word. 

New 


File 

Briefing 

Specialist 

Close 

Amend 

File 

987 

6 

0 

6 

0 

Briefing 

0 

940 

5 

11 

41 

Specialist 

0 

6 

969 

12 

12 

Close 

11 

11 

0 

965 

11 

Amend 

0 

12 

12 

12 

962 

96.48*  recognised  as  correct  word 


TABLE  22.  COMPARISON  BETWEEN  OLD  AND  NEW  REFERENCE  PATTERNS 
(YES,  NO,  AFFIRMATIVE,  NEGATIVE) 


Old 


No 

Yes 

Affirmative 

Negat ive 

No 

982 

0 

11 

5 

Yes 

11 

988 

0 

0 

Affirmative 

0 

0 

988 

11 

Negative 

0 

0 

17 

982 

98.55Z  recognized  as  correct  word. 


New 


Yes 

No 

Affirmative 

Negative 

Yes 

977 

0 

5 

17 

No 

0 

971 

28 

0 

Affirmative 

0 

0 

981 

18 

Negative 

0 

0 

12 

987 

97 .942  recognized  as  correct  word. 
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TABLE 

23. 

COMPARISON  BETWEEN 

OLD  AND  NEW 

REFERENCE  PATTERNS 

(DIGITS  ZERO 

THROUGH  NINE 

,  PLUS 

YES  AND 

NO) 

Old 

Zero 

One 

Two 

Three 

Four 

Five 

Six 

Seven 

Eight 

Nine 

No 

Yes 

Zero 

920 

0 

11 

0 

11 

0 

0 

16 

0 

11 

16 

11 

One 

0 

955 

0 

0 

5 

11 

0 

0 

0 

0 

0 

27 

Two 

16 

0 

950 

0 

5 

0 

5 

16 

0 

0 

5 

0 

Three 

0 

0 

11 

971 

5 

0 

0 

0 

0 

11 

0 

0 

Four 

5 

22 

5 

0 

954 

0 

0 

0 

5 

0 

0 

5 

Five 

0 

29 

0 

0 

11 

911 

5 

23 

5 

11 

0 

0 

Six 

0 

0 

0 

0 

0 

0 

977 

0 

16 

5 

0 

0 

Seven 

11 

0 

16 

5 

22 

5 

5 

906 

11 

0 

5 

11 

Eight 

0 

0 

5 

11 

11 

0 

93 

0 

853 

5 

5 

11 

Nine 

0 

17 

0 

34 

0 

98 

5 

17 

0 

826 

0 

0 

No 

22 

0 

5 

5 

11 

0 

0 

22 

0 

11 

920 

0 

Yes 

11 

0 

0 

0 

5 

0 

5 

23 

23 

0 

11 

918 

92 

.282  recognised  as  correct 

word. 

New 

Zero 

One 

Two 

Three 

Four 

Five 

Six 

Seven 

Eight 

Nine 

No 

Yes 

Zero 

971 

0 

5 

0 

11 

0 

0 

0 

0 

0 

5 

5 

One 

0 

956 

0 

0 

10 

10 

0 

0 

10 

0 

0 

10 

Two 

16 

0 

960 

0 

0 

0 

5 

5 

0 

3 

5 

0 

Three 

0 

0 

0 

954 

0 

5 

16 

0 

5 

16 

0 

0 

Four 

0 

0 

0 

11 

971 

0 

5 

5 

5 

0 

0 

0  i 

$ 

Five 

0 

11 

0 

0 

0 

890 

5 

17 

0 

75 

0 

o  1 

Six 

0 

0 

0 

0 

5 

5 

927 

27 

22 

11 

0 

0  1 

=y 

Seven 

10 

0 

5 

0 

10 

3 

32 

906 

0 

10 

0 

16 

Eight 

0 

0 

5 

17 

11 

0 

28 

0 

920 

11 

0 

5 

;'!v 

Nine 

0 

0 

0 

5 

0 

46 

0 

5 

0 

942 

0 

0 

No 

5 

0 

0 

0 

5 

0 

0 

22 

0 

3 

960 

0  ;  /;! 

Yes 

17 

5 

11 

0 

5 

0 

17 

11 

5 

0 

0 

926  [ 

'«k 

.  .> 

94.032  recognised  as  correct  word.  f 

4 

9 
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Zula 

Quebec 

India 

Char 

Bravo 

Tango 

Juli 

Unit 

TABLE 

Roaeo 

24.  OOK7U8IOH  MATRIX  101  PHOMETIC  A 

Alpha  Papa  Httia  Delta  Xray  Mike 

Zula 

936 

0 

12 

0 

0 

4 

0 

4 

0 

0 

0 

0 

0 

4 

0 

Quebec 

0 

872 

3 

0 

0 

7 

19 

0 

0 

0 

0 

31 

0 

27 

3 

India 

16 

8 

904 

0 

0 

0 

12 

8 

0 

0 

0 

0 

0 

4 

0 

Charlie 

0 

0 

0 

964 

3 

0 

0 

3 

7 

0 

0 

0 

0 

0 

7 

Bravo 

0 

0 

0 

0 

936 

0 

3 

0 

3 

0 

19 

0 

0 

0 

0 

Tango 

0 

0- 

7 

0 

3 

848 

0 

7 

0 

0 

0 

3 

0 

7 

0 

Juliet 

16 

20 

44 

0 

0 

4 

886 

4 

0 

0 

0 

4 

0 

0 

0 

Unifora 

4 

8 

20 

0 

0 

12 

4 

913 

0 

0 

0 

0 

0 

0 

4 

Rcaeo 

0 

4 

4 

0 

0 

4 

0 

0 

906 

0 

0 

16 

0 

4 

0 

Alpha 

0 

0 

0 

0 

3 

7 

0 

3 

0 

844 

38 

0 

15 

3 

0 

Papa 

0 

0 

3 

3 

11 

3 

0 

7 

0 

11 

906 

0 

0 

11 

0 

Hhiakey 

0 

12 

0 

0 

0 

4 

4 

4 

0 

0 

0 

946 

0 

8 

0 

Delta 

3 

0 

3 

0 

0 

0 

3 

7 

0 

3 

0 

0 

890 

7 

0 

Xray 

0 

0 

8 

0 

0 

4 

0 

8 

0 

0 

4 

8 

4 

931 

0 

Mike 

0 

0 

0 

3 

0 

0 

0 

0 

0 

0 

0 

15 

a 

3 

940 

Moveaber 

20 

4 

12 

0 

0 

4 

12 

4 

4 

0 

0 

0 

0 

4 

4 

Victor 

8 

0 

12 

0 

0 

4 

0 

28 

4 

0 

0 

24 

0 

16 

0 

Foxtrot 

0 

0 

0 

3 

0 

0 

0 

3 

0 

0 

3 

0 

0 

7 

0 

Yankee 

4 

0 

16 

0 

8 

12 

8 

4 

4 

0 

0 

8 

0 

0 

0 

Echo 

7 

0 

3 

0 

0 

50 

0 

19 

0 

3 

3 

0 

0 

7 

0 

Coif 

3 

7 

0 

0 

0 

3 

0 

0 

0 

0 

3 

0 

0 

0 

0 

Kilo 

12 

4 

16 

0 

8 

24 

0 

0 

4 

0 

0 

0 

4 

4 

0 

Hotel 

4 

8 

0 

4 

0 

8 

0 

8 

4 

0 

0 

0 

0 

16 

0 

Sierra 

0 

0 

16 

0 

0 

8 

0 

4 

0 

0 

0 

0 

0 

0 

0 

Oacar 

9 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

4 

4 

0 

8 

0 

Liaa 

4 

0 

4 

0 

0 

12 

4 

37 

16 

0 

4 

20 

0 

4 

12 

90,101  recogaited  aa  correct  word 
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WmiOM  MATRIX  FOR  PHONETIC  ALPHABET 


?iK 

Hhis 

Pslts 

Ersy 

Mite 

Mots 

Viet 

Twt 

Ysnk 

Echo 

Golf 

Kilo 

Hotel 

Sier 

Oscar 

Lias 

0 

0 

0 

4 

0 

0 

8 

0 

0 

0 

0 

16 

0 

0 

0 

12 

0 

31 

0 

27 

3 

0 

11 

0 

0 

0 

15 

0 

0 

0 

0 

3 

0 

0 

0 

4 

0 

4 

4 

0 

4 

0 

0 

4 

0 

29 

0 

0 

0 

0 

0 

0 

7 

0 

0 

0 

3 

0 

3 

3 

0 

0 

0 

0 

19 

0 

0 

0 

0 

3 

3 

0 

3 

0 

0 

15 

0 

0 

3 

3 

0 

3 

0 

7 

0 

0 

7 

0 

11 

87 

0 

7 

3 

0 

0 

0 

0 

4 

0 

0 

0 

0 

0 

0 

0 

4 

0 

8 

0 

8 

0 

0 

0 

0 

0 

0 

4 

0 

4 

4 

0 

0 

0 

16 

0 

4 

4 

0 

0 

16 

0 

4 

0 

4 

0 

4 

8 

0 

8 

8 

12 

0 

4 

12 

34 

0 

IS 

3 

0 

0 

3 

11 

0 

19 

15 

11 

7 

0 

7 

3 

906 

0 

0 

11 

0 

0 

3 

15 

0 

0 

0 

3 

0 

0 

15 

0 

0 

946 

0 

8 

0 

0 

0 

4 

4 

0 

0 

0 

0 

0 

0 

12 

0 

0 

890 

7 

0 

0 

0 

0 

0 

15 

3 

35 

15 

7 

0 

0 

4 

8 

4 

931 

0 

0 

20 

8 

0 

4 

0 

0 

0 

0 

0 

0 

0 

13 

0 

3 

940 

0 

0 

11 

0 

0 

0 

0 

0 

0 

15 

7 

0 

0 

0 

4 

4 

852 

44 

4 

8 

8 

0 

4 

4 

0 

0 

8 

0 

24 
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CONCLUSIONS 


1.  The  prototype  system,  as  demonstrated  using  the  adaptation  strategy  for  flight 
plan  filing,  has  definite  potential  for  application  to  the  enhanced  Model  2  of  the 
Flight  Service  Automation  Program.  f 

2.  The  requirement  to  spell  out  every  flight  plan  entry  character  by  character 
would  try  the  patience  of  the  users.  Even  at  100  percent  accuracy,  the  protracted 
length  of  the  transaction  diminishes  the  attractiveness  of  filing  in  this  manner. 

3.  The  improvement  in  recognition  accuracy  with  the  new  data  base  would  raise  the 
performance  of  the  Mass  Weather  Dissemination  Program  to  a  level  quite  satisfactory 
for  the  general  pilot  population. 

4.  The  dialect  study  and  voice  collection  effort  led  to  an  outstanding  improvement 
in  recognition  accuracy. 


RECOMMENDATIONS 


1.  Simplify  the  procedure  for  filing  a  flight  plan  by  voice  recognition.  Make  it 
unnecessary  for  the  pilot  to  spell  out  every  flight  plan  entry  character  by 
character. 

2.  Develop  additional  software  to  allow  for  further  correction  and  edit 
capability. 

3.  Develop  written  instructions  for  training  general  aviation  pilots  on  how  to  use 
the  system  effectively. 

4.  Install  a  telephone  line  in  the  Millville,  New  Jersey,  Flight  Service  Station 
to  allow  volunteer  general  aviation  pilots  to  access  the  system  at  the  Technical 
Center  and  file  simulated  flight  plans  by  machine  recognition.  Project  personnel 
should  collect  objective  and  questionnaire  data  on  system  performance.  Note: 
Approval  from  OMB  should  be  obtained  prior  to  testing. 

5.  Encourage  user  growth  by  permitting  the  system  to  become  progressively  more 
flexible  with  greater  efficiency  of  input  as  the  user's  skill  and  confidence 
increase. 
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APPENDIX  A 

EXPERIMENTAL  FLIGHT  PLAN  TRANSACTIONS 


In  lieu  of  presenting  a  transcript  of  all  of  the  recorded  briefings,  we  have 
selected  six  experimental  flight  plan  transactions  that  represent  various  levels  of 
recognition  accuracy.  Of  the  six  selected,  th-ee  are  VFR  and  three  are  IFR. 
Figures  A-l  through  A-3  show  three  VFR  transactions  that  reflect  good,  fair,  and 
poor  recognition  accuracy,  respectively.  Similarly,  figures  A~4  through  A-6  show 
three  IFR  transactions  that  likewise  reflect  good,  fair,  and  poor  recognition.  He 
have  defined  "good,"  "fair,"  and  "poor,"  as  follows: 


Good  “  greater  than  95  percent 

Fair  “  between  90  percent  and  95  percent 

Poor  ■  less  than  90  percent 


/ 


=r 

ho 


Computer:  Hello,  this  is  the  pilot's  automated  briefing  system.  Detailed  operating 
instruct  ions  are  available  for  Che  MM  or  occasional  user.  Do  you  wish 
detailed  operating  instructions?  Please  eay  yes  or  no  {Mediately  after 
the  cue-tone. 

User:  negative. 

Computer:  Say  briefing,  file,  SMnd,  specialist,  or  close. 

Oner;  Pile. 

Computer:  Standby  to  speak  your  flight  plan  immediately  after  the  cue-tooe. 

Do  you  wish  to  file  a  VP*  flight  plan?  Say  affimative  or  negative. 

Uaer:  Affirmative. 

Computer:  Did  you  eay  affirmative? 

Uaer:  tea. 

Camp otor:  tor  the  follow!—  eotriee  use  the  phonetic  alphabet,  enters.  aad  the 
words  point,  slant ,  humd rods,  thousands,  and  entot.  All  entrlna  are 
tormina  tad  with  the  word  enter.  After  the  laat  e  lasts  at  of  the  route  of 
flight  has  baoo  entered,  eay  the  word  enter  by  l tee  If  to  proceed  with 
your  flight  plea.  Too  Met  confirm  all  oatriaa  hy  saying  affirmative  or 
negative,  there  will  ho  mo  hoop  tooe  whom  the  girl  aeha  a  question. 

Kotor  eircreft  cell  il|B. 

User:  Hew— her  Sevan  Three  Seven  Kile. 

Computer:  lew— her  Seven  three  levee  Kilo? 

User:  tea. 

Computer:  Continue. 

Door:  Alpha  later. 

Computer:  Alpha  Attention? 

Uaer:  Be. 

Computer:  Sorry,  try 

Veer:  Alpha  Inter. 

Computer:  Alpha  Bator? 

Uaer:  Yea. 

Computer:  Inter  eircreft  typo. 

Uaer:  Papa  Alpha  the  Bight  Inter. 

Camper  or:  Papa  Alpha  the  Bight  later? 

User:  Tea. 

Computer:  later  destination  identifier. 

Uaer:  Alpha  Charlie  lllo  Inter. 

Cempater:  Alpha  Charlie  file  Inter? 

User:  Tea- 

Coo put  or:  Enter  proposed  daparturs  tiue . 

User:  One  Three  Three  Piva  Inter. 

Conpotar:  On#  Tbma  Thrae  line  Intar? 

Uaar:  So. 


Computer:  Sorry,  try  again. 

User:  One  Three  Thrae  Pive  gutar. 

Computer:  One  Three  Three  Pive  later? 

User:  Tea. 

Computer:  later  estimated  tine  «n  route. 

User:  Zero  Two  Pour  Pive  later. 

Computer:  Zero  Two  Pour  Pive  later? 

User:  Tea. 

Computer:  Tbs  following  information  la  recorded  on  audio  tape.  Plane*  use  natural 
•peach  when  you  answer  the  guest ion.  A  a i lanes  of  two  seconds  after 
your  ruaponas  will  advance  you 'to  the  neat  gweetiea.  later  depart asm 
identifier, 

Uaar:  lelwarn  Airpark. 

Computer:  Inter  true  a Ira pond. 

Doer:  ISO. 

Camp  iter:  Intar  altitude. 

Oner:  7  thousand  S  hundred. 

Coaputer:  Inter  special  equipment  cade. 

Uaer:  Xante. 

Computer:  Rater  rente  of  flight. 

Oner:  Direct  Coyle  direct  tear i dance. 

Ceaputer:  Intar  alt—* a  airport. 

•ear:  Seaton. 

Computer:  Intar  (—1  —  heard. 

Osar:  4  hours  and  M  mi  out os. 

Computer:  tutor  m— her  on  heard, 
tear:  S 

campu tar:  Bator  tolar  ef  aircraft. 

Soar:  Irena  end  geld. 

Computer:  Batar  ho—  ha—. 

Dear:  Be— —hat. 

Can put art  Bator  pilot's  name,  eddraaa,  and  telephone  number. 

Uaar;  Subject's  a— a,  address  — 4  telephone  aunber. 

Computer:  Inter  ruamrhs. 

User:  BIT  0.1. 

Computer:  Your  flight  plea  has  bean  aacapted  and  filed.  Do  you  require  additional 
•aaiataaca? 

User:  Yes. 

Coaputer:  Say  Hriafiog,  file,  amend ,  specialist,  or  close. 


FIGURE  A- l 


VFR  TRANSACTION 


GOOD 


A-3 


User: 


No. 


Computer:  Hollo,  this  is  the  pilot's  automated  briefing  system.  Detailed  operating 
instructions  are  available  for  the  new  or  occasional  user.  Do  you  wish 
detailed  operating  instructions?  Please  say  yea  or  no  iamediacely  after 
the  cue-tone. 

User:  No. 

Computer:  Say  briefing,  file,  emend,  specialist,  or  close. 

User.  Pile. 

Coaputer;  Standby  to  speak  your  flight  plan  isnediately  after  the  cue-tone.  Do  you 
wish  to  file  a  VFR  flight  plan?  Say  affirmative  or  negative. 

User:  Affirmative. 

Coaputer:  Did  you  aay  affirmative? 

User:  Yes. 

Coaputer;  For  the  following  entries,  use  the  phonetic  alphabet,  numbers,  and 

the  words  point,  slant,  hundreds,  thousands,  and  enter.  All  entries 
are  terminated  with  the  word  enter.  After  the  last  element  of  the  route 
of  flight  has  been  entered,  say  the  word  enter  by  itself  to  proceed  with 
your  flight  plsn.  You  must  confirm  all  entries  by  saying  affirmative  or 
negative.  There  will  be  no  beep-tone  when  the  girl  asks  a  question. 

Enter  aircraft  csll  sign. 

User.  November. 

Computer:  Attention? 

User:  No. 

Computer:  Sorry,  try  again. 

User:  November  Seven  Three  Seven  Kilo. 

Computer:  Kilo  Seven  Three  Seven  Kilo. 

User:  No, 

Computer:  I’m  sorry.  Was  your  first  word  Kilo? 

User:  No. 

Computer:  What  was  it? 

User:  November. 

Coaputer:  Did  you  aay  November? 

User:  Yes. 

Computer:  Was  the  next  seven? 

User:  Yes. 

Computer:  As  was  the  next  three? 

User:  Yes. 

Computer:  Was  the  next  seven? 

User:  Yes. 

Computer:  Was  the  next  Kilo? 

User:  Yes. 

Computer:  Continue. 

Ueer:  Alpha  Enter. 

Computer:  Please  repeat, 

Usar:  Enter. 

Computer:  Alpha  enter? 

User;  Yea. 

Computer:  Enter  aircraft  type. 

User:  Papa  Alpha  Two  Bight  Enter. 

Coaputer:  Papa  Alpha  Tange  Eighr  Enter? 


Computer:  Sorry,  try  again. 

User:  Peps  Alpha  Two  Eight  Enter. 

Computer:  Papa  Alpha  Two  Eight  Enter? 

User.  Yes. 

Computer:  Enter  Destination  Identifier. 

User:  Alpha  Chsrlie  Kilo  Enter. 

Computer:  Alpha  Chsrlie  Kilo  Enter? 

User:  Yes. 

Computer:  Enter  Departure  Time. 

User:  One  Three  Three  Five  Enter. 

Computer:  One  Three  Three  Five  Enter? 

User:  Yea. 

Computer:  Enter  Time  En  Boute. 

User:  Zero  Two  Four  Five  Enter. 

Computer:  Zero  Two  Four  Five  Enter? 

User:  Yes. 

Computer:  The  following  information  is  recorder  on  audio  tape.  Please  use  natural 
speech  when  you  answer  the  question.  A  silence  of  2  seconds  after 
your  response,  will  advance  you  to  the  next  question.  Enter  departure 
ident if icr. 

User:  Delaware  Airpark. 

Computer:  Enter  true  airspeed. 

User:  120. 

Computer:  Enter  altitude. 

User:  7  thousand,  5  hundred. 

Computer:  Enter  special  equipment  code. 

User :  Tango . 

Computer:  Enter  route  of  flight. 

User:  Direct  Coyle  direct  Providence. 

Computer:  Enter  alternate  airport. 

User:  Boston. 

Computer:  Enter  fuel  oo  board. 

User:  4  hours  and  JO  minutes. 

Computer:  Enter  number  on  board. 

User:  2. 

Computer:  Enter  color  of  aircraft. 

User:  Brown  and  fold. 

Computer:  Enter  home  base. 

Usar:  Nantucket. 

Computer:  Enter  pilot’s  name,  address,  and  telephone  number. 

Ueer:  Subject’ a  name,  address,  and  telephone  number. 

Computer:  Enter  remarks. 

User:  ELT  O.K. 

Computer:  Your  flight  plan  has  been  excepted  and  filed.  Do  you  require  additional 

assist ance? 

User:  No. 

Computer:  Thank  you.  Nave  a  good  day. 
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Coaputn :  Rtllo,  this  is  the  pilot'*  iutoMted  brief  inf  system.  Detailed  operating 
i net ruction*  ere  available  for  Che  new  or  occee ioaal  ui«r.  Do  you  with 
detailed  operating  instructions?  Please  say  yes  or  no  isssediately  after 
the  cue-tone. 

User:  Mo. 

Coaputer;  Say  briefing,  file,  amend,  specialist,  or  close. 

User:  Pile. 

Coaputer:  Standby  to  speak  your  flight  plan  iaeediately  after  the  cue-tone. 

Do  you  wish  to  file  a  VPK  flight  plant  Say  affirmative  or  negative. 

User:  Affirmative. 

Coaputer:  Did  you  say  affirmative? 

User:  Affirmative? 

Computer:  Por  the  following  entries  use  the  phonetic  alphabet,  numbers,  end 

the  words  point,  slant,  hundreds,  thousands,  and  enter.  All  entries 
are  terminated  with  the  word  enter.  After  the  last  element  of  the 
route  of  flight  has  been  entered,  say  the  word  enter  by  itself  to 
proceed  with  your  flight  plan.  You  aust  confirm  all  entries  by  saying 
affirmative  or  negative.  There  will  be  no  beep  tone  when  the  girl  asks  a 
question.  Enter  aircraft  call  sign. 

User:  November  Seven 

Coaputer:  Please  repeat. 

Uaer:  Three  Seven  Kilo  Alpha  Enter? 

Computer:  Five  Three  Hundred  Alpha? 

User:  Negative. 

Computer:  Sorry,  try  again: 

User:  November  Seven  Three  Seven  Kilo. 

Computer:  November  Seven  Three  Seven  Kilo? 

User:  Alpha. 

Computer:  Please  repeat. 

User:  Affirmative. 

Computer:  Continue. 

User:  Alpha  Cater  Enter. 

Computer:  Alpha  Tango  Cater? 

Use i .  Negative. 

Computer:  Sorry,  try  agaia. 

User:  Alpha  later. 

Computer:  Alpha  Cater? 

Veer:  Mflnatlw. 

Computer:  later  Aircraft  Type. 

gear:  Papa.  Alpha  the  light  Cuter. 

Caapmter:  Oecar  Buadrad  Two  Lima  Cater? 

Baer:  Negative. 

C sap  liter:  tarry,  try  agaia. 

Bear:  Papa  Alpha  Twa  fight  Cater. 

Pimp  tee:  Papa  Alpha  The  Lima  Cater? 


Caapmter:  I’m  tarry  —  Baa  year  first  dari  Papa? 
Baer:  Affirmative. 

Caapmter:  Wm  the  neat  Alpha? 

Bear:  Affimtia. 

Caapmter:  wm  tha  meat  the? 


User:  Eight. 

Computer:  Did  you  eay  eight? 

User:  Affirmative. 

Coaputer:  Has  the  next  Enter? 

Ueer:  Affirmative. 

Computer:  Enter  destination  idantifier. 

User:  Alpha  Charlie  Kilo  Enter. 

Computer:  Six  Charlie  Kilo  Enter? 

Uaer:  Negative. 

Computer:  Sorry,  try  again. 

Uaer:  Alpha  Charlie  Kilo  Enter. 

Computer:  Alpha  Charlie  Kilo  Enter? 

Uaer:  Affirmative. 

Computer:  Enter  departure  tiamt. 

User:  One  Three  Three  Five  Enter. 

Computer:  Hundred  Three  Three  five  Enter? 

User:  Negative. 

Computer:  Sorry,  try  again. 

User:  One  Three  Three  Five  Enter. 

Computer:  One  Three  Three  Five  Enter? 

User:  Affirmative. 

Computer:  Enter  estimated  time  en  route. 

User:  Zero  Two  Four  Five  Enter 

Computer:  Zero  Two  Four  Five  Enter? 

User:  Affirmative. 

Computer:  The  following  information  is  recorded  on  audio  tape. 

speech  when  you  answer  the  question.  A  silence  of  2 
your  response  will  advance  you  to  the  next  question, 
identifier. 

•nr:  Da  lawn  re  Airpark. 

Computer:  gator  true  airapaad. 

User:  120. 

Computer:  Enter  altitude. 

User:  ?  thousand,  5  hundred. 

Computer:  Cater  special  aqaipmeot  coda. 

Hear:  Tsago. 

Camp  liter:  Eater  mute  ef  flight. 

Osar:  Direct  Cmyle  direct  From  ids ace. 

Computer:  Cater  alternate  airport. 

Boer:  Bee tea. 

Compete r:  Cater  fuel  ea  heard. 

Beer:  A  heart  ami  ft  mi  mates. 

Computer:  Cater  muBher  ea  hoard, 
gear:  t. 

Computer:  Cater  color  of  aircraft. 

Boer:  Breum  amd  geld. 

Cmb liter:  Cater  heme  heeo. 


Please  use  natural 
seconds  after 
Enter  departure 


Affirmative 


Beer: 


Neat achat. 
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Uut  : 


User : 


Affirmative . 


No. 

Computer:  toy  briefing,  file,  amend,  specialist,  or  cloee. 

Oeer:  tile. 

Computer:  Standby  to  apeak  your  flight  plea  iModiately  after  the  cue-tone. 

Do  you  wieto  to  file  a  VF1  flight  plan?  Say  affirmative  or  negative. 

User:  Affirmative. 

Computer:  Did  you  any  affirmative? 

Dear:  Affirmative? 

Computer:  For  the  following  entriea  uae  the  phonetic  alphabet,  numbere,  and 

Che  word*  point,  alant ,  hundred* ,  tbouaanda,  and  enter.  All  entriea 
are  terminated  with  the  word  enter.  After  the  leat  element  of  the 
route  of  flight  he*  been  entered,  aay  the  word  enter  by  itaelf  to 
proceed  with  your  flight  plan.  You  must  confirm  all  entriee  by  saying 
affirmative  or  negative.  There  will  be  no  beep  tone  when  the  girl  aaka  a 
question.  Enter  aircraft  call  aign. 

User:  November  Seven 

Computer:  Please  repeat. 

User:  Three  Seven  Kilo  Alpha  Enter? 

Computer:  Five  Three  Hundred  Alpha? 

User:  Negative. 

Computer:  Sorry,  try  again: 

Uaer:  November  Seven  Three  Seven  Kilo. 

Computer:  November  Seven  Three  Seven  Kilo? 

Uaer:  Alpha. 

Computer:  Pleaae  repeat. 

Uaer;  Affirmative. 

Computer:  Continue. 

Uaer:  Alpha  Enter  Enter. 

Computer:  Alpha  Tango  Enter? 

Uaer:  Negative. 

Computer:  Sorry,  try  again. 

Osar:  Alpha  Enter. 

Computer:  Alpha  Enter? 

Uaer:  Affirmative. 

Computer:  Enter  Aircraft  Type. 

Oeer:  Papa  Alpha  Two  Eight  Enter. 

Computer:  Oscar  Nwndrod  Two  Lime  Eater? 

Oeer:  Negative. 

Computer:  Sorry,  try  egaia. 

Oeer:  Tope  Alpha  Two  light  Enter. 

Cfwrer:  Pape  Alpha  Two  Lima  Enter? 

deer:  Negative. 

Computer:  I'm  terry  —  Vaa  your  flrat  word  Nope? 
goer:  Affirmative . 

Computer:  Noe  the  tent  Alpha? 

Now:  Affirmative. 

Cempater:  We*  the  ant  Tue? 

Uaer:  Affirmative. 

Ccmpwter:  Wee  the  went  Lime? 

Noor:  Negative. 

Cmpatari  Oh  at  moo  it? 

Oner:  tight. 

Computer:  Did  you  say  Tie ter? 

Doer:  Negative. 

Computer;  That  did  you  aoy? 


Computer:  Nee  the  next  Enter? 

Uaer:  Affirmative. 

Computer:  Enter  declination  identifier. 

Ueer:  Alpha  Charlie  Kito  Enter. 

Computer:  Six  Charlie  Eilo  Enter? 

User:  Negative. 

Computer:  Sorry,  try  again. 

Uaer:  Alpha  Charlie  Kilo  Enter. 

Computer:  Alpha  Charlie  Kilo  Enter? 

Ueer:  Affirmative. 

Computer:  Enter  departure  tiam. 

Uaer:  One  Three  Three  Five  Enter. 

Computer:  Hundred  Three  Thre  •  Five  Enter? 

User:  Negative. 

Computer'  Sorry,  try  again. 

User:  One  Three  Three  Five  Enter. 

Computer:  One  Three  Three  Five  Enter? 

User:  Affirmative. 

Computer:  Enter  eetimated  time  en  route. 

User:  Zero  Two  Four  Five  Enter 

Computer:  Zero  Two  Four  Five  Enter? 

User:  Affirmative. 

Computer:  The  following  information  ia  recorded  on  audio  tape.  Please  use  natural 
speech  when  you  answer  the  question.  A  a i lame*  of  2  seconds  after 
your  response  will  advance  you  to  the  meet  question.  Enter  departure 
identifier. 

Uaer:  Delaware  Airpark. 

Computer:  Enter  true  airspeed. 

User:  120. 

Computer:  Enter  altitude. 

User:  7  thousand,  5  hundred. 

Computer:  Enter  special  equipment  code. 

Ueer:  Tango. 

Computer:  Enter  route  of  /fight. 

Dear:  Direct  Coyle  direct  Providence. 

Computer:  Enter  alternate  airport. 

Uaer:  ftoetom. 

Computer:  Enter  fuel  on  beard. 

User:  A  boor*  end  39  minutes. 

Computer:  Enter  number  on  board. 

Uaer:  t. 

Camp  liter:  Enter  color  of  aircraft. 

Ueer:  Drown  end  geld. 

Computer:  Enter  home  been. 

Ueer:  Nantucket . 

Computer:  Enter  pilot's  name,  address,  end  telephone  number. 

Ueer:  Dwbject's  sou,  address,  and  telephOM  number. 

Computer:  Enter  remarks. 

Ueer:  ELT  O.K. 

Computer:  Your  flight  plan  hoe  been  filed.  Do  you  require  additional  assistance? 
Doer:  Negative,  Negative. 

Computer:  Thai*  you.  lave  a  nice  day. 
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Computer:  gay  briefing,  file,  amend,  specialist,  or  clot*. 

Omi:  Pile. 

Computer:  Standby  to  apeak  your  flight  plan  iamadiately  after  the  cut'toa*. 

Do  you  wiah  to  file  a  VFt  flight  plan?  Say  affimativa  or  nagativa. 

Ueer:  Negative. 

Computer:  For  the  following  entriea,  uaa  the  phonetic  alphabet,  numbers,  and  the 
worda  point,  el jot,  hundred,  thouaaada,  and  eater.  All  entriea  are 
laminated  with  the  word  enter.  Aftar  the  laet  element  of  the  route  of 
flight  baa  bean  entered  aay  the  word  enter  by  itaelf  to  proceed  with  your 
flight  plan.  You  must  confirm  all  entriea  by  saying  affirmative  or 
negative.  There  will  be  no  beep- ton*  when  the  girl  a aka  a  guest  ion. 

Inter  aircraft  call  sign. 

User:  November  Four  One  Zero  Whiskey. 

Computer:  November  Tango  One  Zero  Whiskey? 

l*«er:  No. 

Computer:  Sorry,  try  again. 

User:  November  Four  One  Zero  Whiskey. 

Computer:  November  Four  One  Zero  Whiskey? 

User:  Tea. 

Computer:  Continue. 

Ueer:  Bravo  Inter. 

Computer:  Bravo  Enter? 

User:  Yea. 

Computer:  Enter  aircraft  type  and  special  equipment  code. 

Ueer:  Coif  Two  Slant  Foxtrot  Enter. 

Computer:  Coif  Two  Slant  Foxtrot  Enter? 

Ueer :  Yea. 

Computer:  Enter  deat inat ion  identifier. 

User:  Tango  Peps  Alpha  Enter. 

Computer:  Tango  Papa  Alpha  Enter? 

User:  Tea. 

Computer:  Enter  departure  time. 

User:  Zero  Eight  Five  Zero  Inter. 

Computer:  Victor  Eight  Five  Zero  Enter? 

Uaer:  No. 

Computer.  Sorry,  try  again. 

User:  Zero  Eight  Five  Zero  Enter. 

Computer:  Zero  Bight  Five  Zero  Inter? 

Uaer:  Tea. 

Computer:  Enter  estimated  time  en  route. 

Deer:  Zero  Two  Two  Zero  Enter. 

Computer:  Zero  Two  Two  Zero  Enter? 

Uaer:  Yea. 

Computer:  Enter  aircraft’*  true  airapaad, 

Peer:  Poor  Four  Eero  Intar. 

Comp wear:  Four  Four  Zara  EatarT 
Uaer :  Tea. 

Camp uter:  Bmter  depart urm  identifier. 

User:  Tanga  Tanga  Rsisehir  Eater. 

Computer:  Tange  Tamgm  November  Inter? 

Uaer:  Taa. 

Compel er:  Enter  Propeeed  Alt itede. 

Dear:  Three  timer  Sara  Eater. 

Computer:  Three  timer  (are  EatarT 
Imt:  Taa. 


Computer:  There  ia  am  preferred  route  for  your  entry.  Eater  first  route  element. 
User:  Tango  ^‘aago  November  Two  Enter. 

Computer:  Tango  Tango  Nuvamber  Two  Entar? 

Uaer:  Taa. 

Computer:  Entar  nest  route  element. 

User:  Romeo  India  Charlie  Entar. 

Computer:  Borneo  India  Charlie  Entar? 

Uaer:  Yea. 

Computer:  Entar  naat  route  element. 

Uaer:  Juliette  Five  Two  Enter. 

Computer:  Juliette  Five  Two  Enter? 

Uaer:  Yea. 

Computer:  Eater  nest  route  element. 

Uaer:  Cherlic  Alpha  Echo  Enter. 

Computer:  Charlie  Alpha  Echo  Enter? 

Uaer:  Yea. 

Computer:  Enter  next  route  element. 

Uaer:  Juliette  Seven  Five  Enter. 

Computer:  Juliette  Seven  Five  Enter? 

Uaer:  Yea. 

Computer:  Enter  next  rout*  element. 

Uaer:  Tango  Alpha  Yankee  Enter. 

Computer .  Tango  Alpha  Yankee  Eater? 

User:  Yea. 

Computer:  Enter  next  route  clement. 

User:  Juliette  One  One  timer  Enter. 

Computer:  Juliette  One  One  Niner  Enter? 

Uaer:  Yes. 

Computer:  Enter  next  route  element. 

User:  Enter. 

Computer:  Enter? 

Uaer:  Yea. 

Computer:  Enter  remarks. 

Uaer:  Alpha  Delta  Charlie  Uniform  Inter. 

Computer:  Alpha  Delta  Charlie  Uniform  Eater? 

User:  Yes. 

Computer:  The  following  information  ia  recorded  on  audio  tape-  Fiona#  use  natural 
speech  when  you  answer  the  question.  A  alienee  of  2  seconds  after  your 
response  will  advance  you  to  the  next  question.  Enter  alternate  airport. 

Uaer:  St.  Fetaraburg. 

Computer:  Inter  fuel  on  board. 

User:  A  hour*. 

Computer:  Entar  mater  on  board. 

Veer:  10. 

Camp  star:  Enter  enter  ef  aircraft. 

Ueer;  Orange  and  grown. 

Computer:  Entar  homo  base . 

Uaer:  Philadelphia. 

Computer:  Pilot's  name,  address,  and  telephone  musber. 

User:  Subject's  name ,  address,  end  telephone  number. 

Computer:  Tour  flight  plan  hae  been  excepted  and  filed.  Do  you  require  additional 
oeeietance? 

Uaer:  No. 

Computer;  Thank  you.  Hava  a  * >od  day. 
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Computer:  Say  hri«(i«|,  file,  wend,  specialist,  or  close. 

User:  Fit*. 

Computer:  Standby  Co  apeak  your  flight  plan  ived  Lately  aftar  the  cuo-tooa.  Do  you 
wish  to  file  a  m  flight  plan?  lay  affirmative  or  negative. 

Uaar:  Negative. 

Computer:  Did  you  aay  negative? 

Uaar:  too. 

Computer:  For  the  following  antriaa,  uaa  tha  phooetic  alphabet,  nuabara,  and  the 
words  point  a,  alant,  hundreds,  thouaaada,  and  antar.  All  antriaa  arc 
terminated  with  tha  word  enter.  Aftar  the  laat  element  of  the  route  of 
flight  hae  been  entered ,  aay  tha  word  enter  by  itaalf  to  proceed  with 
your  flight  plan.  You  wuat  confirm  all  antriaa  by  aaying  affirmative  or 
negative.  Thera  will  ha  no  baep-toee  whan  tha  girl  asks  a  question. 

Inter  aircraft  call  aign. 

User:  loaa o  Alpha  November  Two  Sevan. 

Computer,  Romeo  Alpha  November  Two  Actant ion? 

Uaar:  No. 

Computer;  Sorry,  Cry  again. 

Uaar:  tomeo  Alpha  Navambar  two  Sevan. 

Computer:  Eomao  Alpha  November  Two  Accent ioa? 

Uaar :  No . 

Computer:  I'm  sorry  —  Waa  your  firat  word  Romeo? 

Uaar:  Yea. 

Computer:  Waa  the  neat  Alpha? 

Uaar:  Yea. 

Computer:  Waa  the  neat  November ? 

User:  Yea. 

Computer:  What  waa  ic? 

Uaar:  November. 

Computer:  DU  yew  say  Bocal? 

Uaar:  No. 

ttMputer:  What  did  you  aay? 

Uaar:  November. 

Computer:  Did  you  aay  Lima? 

User:  No. 

Computer:  later  aircraft  cell  aign. 

Dear:  Ncevo  Alpha  November  Two  Sevan. 

Computer:  Roma a  Alpha  November  Two  X-ray? 

User:  No. 

Camp  lit  or:  Sorry,  try  again. 

Uaar:  Romeo  Alpha  November  Two  levee. 

Comparer:  Romeo  Alpha  Novwbnr  Two  Sevan? 

Dear:  Tea. 

Computer:  Continue. 

Oner:  Five  Inter  Inter  Inter. 

Camper. er:  Five  Victor  Taago  later? 

Uaar :  No . 

Computer:  Sorry,  try  again. 

Uaar:  Five  later. 

Comp  a tar:  Five  later? 

Uaar:  Tea. 

Computer:  later  aircraft  type  iJ  epecial  aq  wipes  at  coda. 

Uaar:  levator  Delta  Two  Sia  fleet. 

Computer:  laawator  Delta  Two  Sis  Slant? 

Uaar:  Tea. 

Computer:  Coat  lame. 

Near:  Alpha  later. 

Computer:  Alpha  lacerf 
Uaar:  Tar. 

Computer:  tat  or  Neat  Laat  ioa  Ueetlfier. 

•ear:  Julietta  Feat rat  Kilo  let or. 

C— pater :  Julietta  Feat-rat  lila  later? 


Uaar:  Tea. 

Computer:  Eater  proposed  departure  time. 

Uaar:  Two  Zero  Three  taro  Erter. 

Computer:  Two  Zero  Three  Zero  Enter? 

Uaar :  Tea . 

Computer:  Enter  estimated  time  en  route. 

User:  Zero  Zero  four  Five  Enter. 

Computer:  Faro  Zero  Four  Five  Enter? 

User:  Yea. 

Computer:  Enter  erwa  aira  peed. 

Uaar:  Two  Zero  Zero  later. 

Caaaputar:  Two  Zero  Zero  Inter? 

Uaar:  Tea. 

Computer:  later  departure  identifier. 

User:  Alpha  Charlie  Yankee  Enter. 

Computer:  Alpha  Charlie  Yankee  Enter? 

User:  Yea. 

Computer:  Enter  proposed  altitude. 

User:  Five  Thousand  Enter. 

Computer:  Five  Thousand  Attention? 

User:  No. 

Computer:  Sorry,  try  again. 

User:  Five  Thousand  Enter. 

Computer:  Five  Thousand  Enter? 

User:  Yea. 

Computer:  There  la  oo  preferred  route  for  your  entry.  Enter  firat  route  alaaaent 
User:  Charlie  Yankee  Noveaber  Enter. 

CtMputer:  Charlie  Yankee  November  Enter? 

User:  Yea. 

Computer:  Enter  next  route  element. 

User:  Victor  One  Six  Eater. 

Comouter:  Victor  One  Six  Enter? 

Uaar:  Yea. 

Computer:  Eater  eext  route  element. 

Uaar:  Eater. 

Computer:  Eater? 

Uaar:  Yes. 

Computer:  later  remarks. 

User:  November  Oscar  November  Echo  Eater. 

Computer:  November  Oscar  November  Echo  later? 

User:  Tea. 

Computer:  The  fol lowing  informat ioa  it  recorded  on  audio  tape.  Fleaae  use  natural 
speech  when  you  an ewer  the  question.  A  sileaca  of  2  seconds  aftar  your 
response  will  advance  you  to  tha  next  question.  Inter  alternate  airport. 

User:  Newark. 

Computer:  later  fuel  on  board. 

User:  3  hours. 

Camp star:  Cater  number  on  board. 

Uaar:  13. 

Computer:  Satar  color  of  aircraft. 

Osar:  Whits  and  Hue. 

Computer:  later  beam  baas. 

Uaar:  North  Philadelphia. 

Camper at:  Fi lot's  name,  address,  and  telephone  nuaber. 

Uaar:  SWbJnct's  name,  address,  and  telephone  nuWer. 

Camp  star:  Tout  flight  plan  has  Waa  excepted  and  filed,  to  yew  reqwire  additional 
aasi stance? 

User:  Tea. 

Camp star:  Say  briefing,  fits,  maced,  specialist,  er  close. 
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Computer:  Say  briefing,  file,  amend,  specialist.  or  close. 

I'wr;  File. 

Computer:  Standhv  to  •cp.-.tk  your  flight  plan  iimne.l i it «*lv  after  Che  cue-tone.  Do  you 
wish  to  file  a  VKH  flight  plan?  Say  affirmative  .»r  negative. 

Uaer :  Negative. 

Computer:  Did  you  soy  negative? 

Uaer:  Affirmative. 

Computer-  For  the  following  entries,  uae  the  phonetic  alphabet,  numbera,  and  the 
words  point,  slant ,  hundred*,  thousand*,  and  enter.  All  entriea  are 
terminated  with  the  word  enter.  After  the  laat  element  of  the  route  of 
flight  ha*  been  entered,  say  the  word  enter  by  itself  to  proceed  with 
vour  flight  plan.  You  must  confirm  all  entries  by  saying  affirmative  or 
negative.  There  will  be  no  beep-tone  when  the  girl  asks  a  question. 

Enter  aircraft  call  sign. 

User:  November  Four  One  Zero  Whiskey. 

Computer:  Nove*d>er  Four  One  Zero  Whiskey? 

User:  Affirmative. 

Computer:  Continue. 

t'ser:  Bravo  Enter. 

Computer.  Bravo  Enter? 

User;  Affirmative. 

Computer-  Enter  aircraft  type  and  special  equipment  code. 

User:  Cotf  Two  Slant  Foxtrot  Enter, 

computer:  Coif  Two  Slant  Foxtrot  Enter? 

User:  Affirmative. 

Computer:  Please  repeat. 

U*er :  Affirmative. 

Computer:  Enter  destination  identifier. 

User:  Tango  Papa  Alpha  F.nter 

Computer:  Tango  Papa  Alpha  Enter? 

User:  Affirmative. 

Computer:  Enter  departure  time. 

User:  Zero  Eight  Five  Zero  Enter. 

Computer:  Zero  Eight  Five  Zero  Enter? 

User:  Affirmative. 

Computer:  Enter  estimated  time  rn  route. 

Uaer:  Zero  Two  Two  Zero  Enter. 

Cosiputer:  Zero  Two  Two  Zero  Enter? 

User:  Affirmative. 

Computer:  Inter  true  airspeed. 

Uaer;  Four  Four  Zero  Enter. 

Computer :  Four  Four  Zero  Enter? 

Uaer;  Affirmative. 

Computer:  Enter  departure  identifier. 

Ue«r:  Tango  Tango  November  Enter. 

Computer:  X-ray  Tango  November  Enter? 

uaer:  Negative. 

remp nr rr~  Enter  proposed  altitude. 

Ueer:  Three  Miner  Zero  Enter. 

Computer:  Three  Miner  Zero  Enter? 

User:  Affirmative. 

Computer:  There  is  no  preferred  route  for  your  entry.  Inter  first  route  element . 
User:  Tango  Tango  Nevvnfcer  Two  Inter. 

Computer:  Tango  Tango  Novas* er  Too  Inter? 

Uaer:  Affirmative. 

Computer:  Enter  pent  route  element . 

Vest:  tsars  Mil  Charlie  Inter. 

Computer:  homes  India  Charlie  Inter? 

dear:  Affirmative. 

Computer:  Inter  went  route  element . 
ttaer :  Juliette  Five  Too  Inter. 


Computer:  Enter  next  route  element . 

User:  Juliette  Seven  Five  enter. 

Computer:  Slant  Saven  F.cho  enter? 

User:  Negative. 

Computer:  Sorry,  try  again. 

Uaer:  Juliette  Seven  Five  enter. 

Computer:  Juliette  Seven  Five  enter? 

User:  Affirmative. 

Computer:  I'm  sorry  — Was  your  first  word  Juliette? 
User:  Affirmative. 

Computer:  What  waa  it? 

Uaer:  Juliette. 

Computer:  Did  you  say  India? 

Uaer:  Negative. 

Computer:  Fleaat  repeat. 

Uaer:  No. 

Computer:  What  did  you  any? 

Uaer:  Juliette. 

Computer:  Did  you  aey  Slant? 

Uaer:  No. 

Computer:  Enter  neat  route  clement . 

Uaer:  Juliette  Seven  Five  enter. 

Computer:  Juliette  Seven  Five  enter? 

Uaer:  Affirmative. 

Computer:  Enter  meat  route  element. 

Uaer:  Tango  Alpha  Yankee  enter. 

Computer:  Fleeee  repeat. 

Uaer:  Inter. 

Computer:  Tango  Alpha  Yankee  Victor  enter? 

Uaer:  Negative. 

Computer:  Sorry,  try  again. 

Uaer:  Tango  Alpha  Yankee  enter. 

Computer:  Tango  Alpha  Yankee  enter? 

Uaer:  Affirmative. 

Computer:  t*m  sorry  —  Was  your  first  word  Tango? 
Uaer:  Yee. 

Computer:  Wes  the  neat  Alpha? 

Uaer:  Yea. 

Computer:  Waa  the  nest  Yankee? 

Uaer:  Yea. 

computer:  Waa  the  neat  Inter? 

Uaer:  Yas. 

Computer:  Inter  swat  route  element. 

Uaer:  Julietta  One  One  Niner  enter. 

Computer:  Juliette  One  One  X-ray  X-ray? 

Uaer:  ho. 

Computer:  Sorry,  try  again. 

Uaer:  Julietta. 

Computer:  F lease  repeat. 

Uaer:  Julietta. 

Computer:  Inter  neat  mute  a  lament , 

Otar:  Julietta  One  One  liter  later. 

Computer:  Julietta  One  One  Niger  Inter. 

Uaer:  Yea. 

Computer:  Inter  neat  rente  e laming . 

User:  Intar. 

Computer:  Inter? 

Ueer:  Yea. 


(Mfsttr:  Julietta  Five  Two  Inter? 
Uaer:  Affirmurivw. 


Computer:  Inter  ramaths. 


T 
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C#er  Afftrwtivf 

Computer  F.nler  aircraft  type  «nd  special  equipment  cod*. 

User ;  Go  It  Two  Slant  Foxtrot  Enter. 

Computer:  Colt  Two  Slant  Foxtrot  Enter! 

User;  Affirmative. 

Computer  Ple*se  repeat. 

I'trr  Affirmative. 

Computer-  Enter  destination  identifier. 

User ;  Tango  Papa  Alpha  F.nter 

Computer:  Tango  Papa  Alpha  Enter? 

User:  Affirmative 

Computer:  Enter  departure  time. 

User:  Zero  Eight  Five  Zero  Enter. 

Computer:  Zero  Eight  Five  Zero  Enter? 
liter-  Affirmative. 

Computer:  Enter  estimated  time  en  route, 
liter:  Zero  Two  Two  Zero  Enter. 

Computer:  Zero  Two  Two  Zero  Enter? 

Uaer :  Affirmative. 

Computer:  Enter  true  airspeed. 

User.  Four  Four  Zero  Enter. 

Computer:  Four  Four  Zero  Enter? 

User:  Affirmative. 

Computer:  Enter  departure  identifier. 

User:  Tango  Tango  November  Enter. 

Computer:  X-ray  Tango  November  Enter? 

Uaer:  Negative. 

Computer:  Enter  proposed  altitude. 

User:  Three  Miner  Zero  Enter. 

Computer:  Three  Miner  Zero  Enter? 

User:  Affirmative. 

Computer:  There  is  no  preferred  route  for  your  entry.  Enter  first  romte 
User:  Tango  Tango  November  Two  Inter. 

Computer:  Tango  Tango  November  Two  Enter? 
liter:  Affirmative. 

Computer:  Enter  next  route  clement . 

Uaer:  Romeo  India  Charlie  Enter. 

Computer:  Romeo  India  Charlie  Enter? 

User:  Affirmative. 

Computer:  Enter  next  route  element. 

User:  Juliette  Five  Two  Enter. 

Computer:  Juliette  Five  Two  Enter? 

User :  Affirmative. 

Computer:  Enter  next  route  element . 

User:  Cher lie  Alpha  Echo  enter. 

Computer :  Charlie  Alpha  Echo  enter? 

Ueer :  Affirmative. 

Computer:  Sorry,  try  again. 

User:  Affirmative  Alpha  Echo  enter. 

Computer:  X-ray  Alpha  Echo  enter? 

User  Negative. 

Computer.  I'm  sorry  ---  wax  your  first  word  X-ray? 

Uaer.  Negative. 

Computer:  What  was  it? 

User  Charlie. 

Computer  Did  you  say  Charlie? 

User:  Affirmative. 

Computer:  What  did  vou  say? 

User:  Charlie. 

Computer  Did  v«e»  sav  piiint  7 
User:  Negative. 

Computer;  Enter  next  route  element. 

Ueer:  Charlie  Alpha  Echo  voter. 

Computer:  Charlie  Alpha  (th«  enter? 

Dhr:  Affirmative 


C ampul  er  : 

User: 

Computer: 

User: 

Computer: 

User: 

Com  put  •  r : 
User: 
Comput  er : 
User: 
Confute  r 
User: 
Computer 
User 

Computer 

.'srr : 

Computer : 

User  : 

Computer: 

User: 

Computer: 

User. 

Computer. 

User: 

t.  ampul  r  r  . 

User: 

Computer: 

User: 

Computer: 

User: 


What  did  you  say? 

Julietta. 

Did  you  say  Slant? 

No. 

Enter  neat  route  element . 

Juliette  Seven  Five  enter. 

Juliette  Seven  five  enter? 
Affirmative. 

Enter  next  rewt#  element. 

Tango  Alpha  Yankee  enter. 

Please  repeat. 

Enter . 

Tango  Alpha  Yeahe*  Victor  enter7 
Megst ive 

Sorry,  try  egam 

Tango  Alpha  Yankee  enter. 

Tango  Alpha  Venkov  enter? 

Af f irmat ive  . 

I'm  eorry  —  Was  vowr  first  werd  T* 
Yea. 

Was  the  neat  Alpha7 
Yes. 

Was  the  nest  ViiS**’ 

Yes. 

Was  the  nest  Enter? 

Yea. 

Enter  next  route  element 
Juliette  One  One  Miner  enter. 
Juliette  One  One  g*-rey  X-rav? 


Sorry,  trv  again. 

User:  Juliatta. 

Computer:  flense  repeat. 

User;  Julietta. 

Computer:  Enter  next  route  element . 

User:  Juliette  One  One  Miner  Enter. 

Computer:  Juliett  One  One  Miner  Enter. 

User:  res. 

Computer:  Enter  next  route  element. 

Ueer:  Enter. 

Computer:  Enter? 

User:  Yea. 

Computer:  Enter  remarks. 

User.  Alpha  Delta  Charlie  Unifom  Enter. 

Computer:  Alpha  Delta  Charlie  Unifom  Enter? 

User:  Yes. 

Computer:  The  following  information  is  recorded  on  audio  tape.  Please  use  natural 
speech  idten  you  answer  the  question.  A  silence  of  7  seconds  after  your 
response  will  advance  you  to  the  next  queet ion.  Cnter  alternate  airport. 

User;  St.  Petersburg. 

Computer:  Enter  fuel  on  board. 

User:  A  hours. 

Computer:  Enter  number  on  board. 

User;  10. 

Computer:  Enter  color  of  aircraft. 

User:  Orange  and  brown. 

Computer:  Enter  home  base. 

User:  Philadelphia. 

Computer :  Pilot's  name,  address,  and  telephone  number. 

User:  Subject's  name,  address,  and  telephone  number. 

Computer:  Your  flight  plsn  has  begs  except ed  and  filed.  Do  you  require  additional 
assistance? 

liner:  No. 

Computer:  Please  repeat. 

User :  go. 

Cimptrtvr:  Than 


have  a  good  day. 
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